[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260201 08:57:28.342435 14089 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.194.126:34009
I20260201 08:57:28.344445 14089 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 08:57:28.345468 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:57:28.362746 14095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:57:28.362769 14096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:57:28.363091 14098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:57:28.365381 14089 server_base.cc:1060] running on GCE node
I20260201 08:57:29.467839 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:57:29.468147 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:57:29.468333 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936249468311 us; error 0 us; skew 500 ppm
I20260201 08:57:29.469168 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:57:29.475039 14089 webserver.cc:492] Webserver started at http://127.13.194.126:37039/ using document root <none> and password file <none>
I20260201 08:57:29.475893 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:57:29.476115 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:57:29.476538 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:57:29.482781 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/master-0-root/instance:
uuid: "b276489a2ad345e381884f5f02acee5d"
format_stamp: "Formatted at 2026-02-01 08:57:29 on dist-test-slave-7fnp"
I20260201 08:57:29.490411 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.001s sys 0.007s
I20260201 08:57:29.495517 14104 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:29.496654 14089 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260201 08:57:29.497005 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/master-0-root
uuid: "b276489a2ad345e381884f5f02acee5d"
format_stamp: "Formatted at 2026-02-01 08:57:29 on dist-test-slave-7fnp"
I20260201 08:57:29.497325 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:57:29.551060 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:57:29.552644 14089 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 08:57:29.553098 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:57:29.631656 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.126:34009
I20260201 08:57:29.631703 14155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.126:34009 every 8 connection(s)
I20260201 08:57:29.639819 14156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:29.662662 14156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d: Bootstrap starting.
I20260201 08:57:29.669086 14156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:29.670965 14156 log.cc:826] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d: Log is configured to *not* fsync() on all Append() calls
I20260201 08:57:29.675918 14156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d: No bootstrap required, opened a new log
I20260201 08:57:29.697352 14156 raft_consensus.cc:359] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b276489a2ad345e381884f5f02acee5d" member_type: VOTER }
I20260201 08:57:29.697901 14156 raft_consensus.cc:385] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:29.698143 14156 raft_consensus.cc:740] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b276489a2ad345e381884f5f02acee5d, State: Initialized, Role: FOLLOWER
I20260201 08:57:29.698917 14156 consensus_queue.cc:260] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b276489a2ad345e381884f5f02acee5d" member_type: VOTER }
I20260201 08:57:29.699412 14156 raft_consensus.cc:399] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:57:29.699712 14156 raft_consensus.cc:493] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:57:29.700021 14156 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:29.704535 14156 raft_consensus.cc:515] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b276489a2ad345e381884f5f02acee5d" member_type: VOTER }
I20260201 08:57:29.705302 14156 leader_election.cc:304] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b276489a2ad345e381884f5f02acee5d; no voters:
I20260201 08:57:29.706928 14156 leader_election.cc:290] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:57:29.707231 14159 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:29.710225 14159 raft_consensus.cc:697] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 1 LEADER]: Becoming Leader. State: Replica: b276489a2ad345e381884f5f02acee5d, State: Running, Role: LEADER
I20260201 08:57:29.711098 14159 consensus_queue.cc:237] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b276489a2ad345e381884f5f02acee5d" member_type: VOTER }
I20260201 08:57:29.712147 14156 sys_catalog.cc:565] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:57:29.724191 14161 sys_catalog.cc:455] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b276489a2ad345e381884f5f02acee5d. Latest consensus state: current_term: 1 leader_uuid: "b276489a2ad345e381884f5f02acee5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b276489a2ad345e381884f5f02acee5d" member_type: VOTER } }
I20260201 08:57:29.725503 14161 sys_catalog.cc:458] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [sys.catalog]: This master's current role is: LEADER
I20260201 08:57:29.725239 14160 sys_catalog.cc:455] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b276489a2ad345e381884f5f02acee5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b276489a2ad345e381884f5f02acee5d" member_type: VOTER } }
I20260201 08:57:29.726264 14160 sys_catalog.cc:458] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [sys.catalog]: This master's current role is: LEADER
I20260201 08:57:29.728492 14169 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:57:29.739946 14169 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:57:29.742147 14089 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:57:29.758268 14169 catalog_manager.cc:1357] Generated new cluster ID: 662ac12569f34d5499661b73d8173c62
I20260201 08:57:29.758600 14169 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:57:29.788908 14169 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:57:29.791059 14169 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:57:29.812001 14169 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d: Generated new TSK 0
I20260201 08:57:29.813037 14169 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:57:29.873212 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:57:29.882429 14178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:57:29.884205 14179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:57:29.888330 14181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:57:29.888512 14089 server_base.cc:1060] running on GCE node
I20260201 08:57:29.889379 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:57:29.889595 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:57:29.889752 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936249889733 us; error 0 us; skew 500 ppm
I20260201 08:57:29.890313 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:57:29.894618 14089 webserver.cc:492] Webserver started at http://127.13.194.65:33213/ using document root <none> and password file <none>
I20260201 08:57:29.895155 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:57:29.895354 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:57:29.895618 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:57:29.896721 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-0-root/instance:
uuid: "42aa5ab3fc4949cb91a209b3125b8423"
format_stamp: "Formatted at 2026-02-01 08:57:29 on dist-test-slave-7fnp"
I20260201 08:57:29.902158 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260201 08:57:29.907027 14186 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:29.907874 14089 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260201 08:57:29.908231 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-0-root
uuid: "42aa5ab3fc4949cb91a209b3125b8423"
format_stamp: "Formatted at 2026-02-01 08:57:29 on dist-test-slave-7fnp"
I20260201 08:57:29.908617 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:57:29.927731 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:57:29.929500 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:57:29.932731 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:57:29.938673 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:57:29.938988 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:29.939292 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:57:29.939509 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:30.040107 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.65:41853
I20260201 08:57:30.040165 14248 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.65:41853 every 8 connection(s)
I20260201 08:57:30.047004 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:57:30.061461 14253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:57:30.063154 14254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:57:30.077504 14249 heartbeater.cc:344] Connected to a master server at 127.13.194.126:34009
I20260201 08:57:30.077618 14089 server_base.cc:1060] running on GCE node
I20260201 08:57:30.078094 14249 heartbeater.cc:461] Registering TS with master...
W20260201 08:57:30.078217 14256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:57:30.079258 14249 heartbeater.cc:507] Master 127.13.194.126:34009 requested a full tablet report, sending...
I20260201 08:57:30.079416 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:57:30.079761 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:57:30.079967 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936250079950 us; error 0 us; skew 500 ppm
I20260201 08:57:30.080770 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:57:30.082124 14121 ts_manager.cc:194] Registered new tserver with Master: 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853)
I20260201 08:57:30.083920 14089 webserver.cc:492] Webserver started at http://127.13.194.66:35589/ using document root <none> and password file <none>
I20260201 08:57:30.084407 14121 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54688
I20260201 08:57:30.084606 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:57:30.084918 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:57:30.085278 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:57:30.086792 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-1-root/instance:
uuid: "414512e4b48344429ac2e37bb4d97d1f"
format_stamp: "Formatted at 2026-02-01 08:57:30 on dist-test-slave-7fnp"
I20260201 08:57:30.093501 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260201 08:57:30.098922 14261 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:30.099712 14089 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260201 08:57:30.099975 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-1-root
uuid: "414512e4b48344429ac2e37bb4d97d1f"
format_stamp: "Formatted at 2026-02-01 08:57:30 on dist-test-slave-7fnp"
I20260201 08:57:30.100241 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:57:30.125726 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:57:30.126981 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:57:30.130105 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:57:30.132965 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:57:30.133165 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:30.133400 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:57:30.133538 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:30.232482 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.66:46399
I20260201 08:57:30.232635 14323 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.66:46399 every 8 connection(s)
I20260201 08:57:30.239419 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:57:30.246801 14327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:57:30.248910 14328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:57:30.252576 14324 heartbeater.cc:344] Connected to a master server at 127.13.194.126:34009
I20260201 08:57:30.253042 14324 heartbeater.cc:461] Registering TS with master...
I20260201 08:57:30.254531 14089 server_base.cc:1060] running on GCE node
I20260201 08:57:30.254483 14324 heartbeater.cc:507] Master 127.13.194.126:34009 requested a full tablet report, sending...
W20260201 08:57:30.255956 14330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:57:30.256982 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:57:30.257179 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:57:30.257035 14121 ts_manager.cc:194] Registered new tserver with Master: 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:30.257320 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936250257309 us; error 0 us; skew 500 ppm
I20260201 08:57:30.257822 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:57:30.258822 14121 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54696
I20260201 08:57:30.260480 14089 webserver.cc:492] Webserver started at http://127.13.194.67:42331/ using document root <none> and password file <none>
I20260201 08:57:30.260998 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:57:30.261185 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:57:30.261432 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:57:30.262409 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-2-root/instance:
uuid: "201de2dd2b434ccaa229daddfe43640e"
format_stamp: "Formatted at 2026-02-01 08:57:30 on dist-test-slave-7fnp"
I20260201 08:57:30.266884 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260201 08:57:30.270232 14335 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:30.271034 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260201 08:57:30.271370 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-2-root
uuid: "201de2dd2b434ccaa229daddfe43640e"
format_stamp: "Formatted at 2026-02-01 08:57:30 on dist-test-slave-7fnp"
I20260201 08:57:30.271726 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1769936248176475-14089-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:57:30.301458 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:57:30.303102 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:57:30.306083 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:57:30.309790 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:57:30.310070 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:57:30.310375 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:57:30.310676 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260201 08:57:30.406243 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.67:45595
I20260201 08:57:30.406265 14397 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.67:45595 every 8 connection(s)
I20260201 08:57:30.422214 14398 heartbeater.cc:344] Connected to a master server at 127.13.194.126:34009
I20260201 08:57:30.422571 14398 heartbeater.cc:461] Registering TS with master...
I20260201 08:57:30.423313 14398 heartbeater.cc:507] Master 127.13.194.126:34009 requested a full tablet report, sending...
I20260201 08:57:30.425062 14121 ts_manager.cc:194] Registered new tserver with Master: 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:30.425513 14089 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01460889s
I20260201 08:57:30.426491 14121 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54698
I20260201 08:57:30.482671 14121 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54702:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 08:57:30.486236 14121 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 08:57:30.590682 14214 tablet_service.cc:1505] Processing CreateTablet for tablet dfd3b87e0ebd4ad289fbafcd4319f5fd (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260201 08:57:30.590503 14213 tablet_service.cc:1505] Processing CreateTablet for tablet 2bc6b96debfa423c8bcf2b1d62675e3d (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260201 08:57:30.600134 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd3b87e0ebd4ad289fbafcd4319f5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.605170 14213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc6b96debfa423c8bcf2b1d62675e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.614813 14212 tablet_service.cc:1505] Processing CreateTablet for tablet 7a1db9293fbb4fcea06c7d17a760433f (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260201 08:57:30.619660 14212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1db9293fbb4fcea06c7d17a760433f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.626685 14211 tablet_service.cc:1505] Processing CreateTablet for tablet 243a67c6236549f8902be36013b07bd1 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260201 08:57:30.625622 14210 tablet_service.cc:1505] Processing CreateTablet for tablet f7bd3b5590d04bb688495325a9a90b1d (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260201 08:57:30.630002 14211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243a67c6236549f8902be36013b07bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.629262 14209 tablet_service.cc:1505] Processing CreateTablet for tablet 27f36f86edf44f5b8905d533ea4dee64 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260201 08:57:30.632570 14210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7bd3b5590d04bb688495325a9a90b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.633962 14209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f36f86edf44f5b8905d533ea4dee64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.642400 14208 tablet_service.cc:1505] Processing CreateTablet for tablet e5a1230fe64d426190770e7c042ef14b (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260201 08:57:30.644137 14208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a1230fe64d426190770e7c042ef14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.656320 14288 tablet_service.cc:1505] Processing CreateTablet for tablet 2bc6b96debfa423c8bcf2b1d62675e3d (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260201 08:57:30.653295 14287 tablet_service.cc:1505] Processing CreateTablet for tablet 7a1db9293fbb4fcea06c7d17a760433f (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260201 08:57:30.653228 14286 tablet_service.cc:1505] Processing CreateTablet for tablet 243a67c6236549f8902be36013b07bd1 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260201 08:57:30.668921 14289 tablet_service.cc:1505] Processing CreateTablet for tablet dfd3b87e0ebd4ad289fbafcd4319f5fd (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260201 08:57:30.660437 14362 tablet_service.cc:1505] Processing CreateTablet for tablet 2bc6b96debfa423c8bcf2b1d62675e3d (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260201 08:57:30.670406 14363 tablet_service.cc:1505] Processing CreateTablet for tablet dfd3b87e0ebd4ad289fbafcd4319f5fd (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260201 08:57:30.673964 14288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc6b96debfa423c8bcf2b1d62675e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.679221 14284 tablet_service.cc:1505] Processing CreateTablet for tablet 27f36f86edf44f5b8905d533ea4dee64 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260201 08:57:30.665725 14285 tablet_service.cc:1505] Processing CreateTablet for tablet f7bd3b5590d04bb688495325a9a90b1d (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260201 08:57:30.684568 14283 tablet_service.cc:1505] Processing CreateTablet for tablet e5a1230fe64d426190770e7c042ef14b (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260201 08:57:30.686183 14360 tablet_service.cc:1505] Processing CreateTablet for tablet 243a67c6236549f8902be36013b07bd1 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260201 08:57:30.688818 14207 tablet_service.cc:1505] Processing CreateTablet for tablet 2686011f0c67477890ba751b5bdee121 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260201 08:57:30.690981 14207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2686011f0c67477890ba751b5bdee121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.686237 14359 tablet_service.cc:1505] Processing CreateTablet for tablet f7bd3b5590d04bb688495325a9a90b1d (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260201 08:57:30.679293 14361 tablet_service.cc:1505] Processing CreateTablet for tablet 7a1db9293fbb4fcea06c7d17a760433f (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260201 08:57:30.695638 14287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1db9293fbb4fcea06c7d17a760433f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.696556 14362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc6b96debfa423c8bcf2b1d62675e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.701316 14358 tablet_service.cc:1505] Processing CreateTablet for tablet 27f36f86edf44f5b8905d533ea4dee64 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260201 08:57:30.703683 14359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7bd3b5590d04bb688495325a9a90b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.699999 14282 tablet_service.cc:1505] Processing CreateTablet for tablet 2686011f0c67477890ba751b5bdee121 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260201 08:57:30.707476 14283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a1230fe64d426190770e7c042ef14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.708024 14360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243a67c6236549f8902be36013b07bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.703625 14357 tablet_service.cc:1505] Processing CreateTablet for tablet e5a1230fe64d426190770e7c042ef14b (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260201 08:57:30.711560 14282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2686011f0c67477890ba751b5bdee121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.717515 14356 tablet_service.cc:1505] Processing CreateTablet for tablet 2686011f0c67477890ba751b5bdee121 (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260201 08:57:30.720774 14358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f36f86edf44f5b8905d533ea4dee64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.725170 14356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2686011f0c67477890ba751b5bdee121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.719412 14284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27f36f86edf44f5b8905d533ea4dee64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.727151 14357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a1230fe64d426190770e7c042ef14b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:57:30.734841 14168 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:57:30.731050 14361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a1db9293fbb4fcea06c7d17a760433f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.737061 14285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7bd3b5590d04bb688495325a9a90b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.765915 14363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd3b87e0ebd4ad289fbafcd4319f5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.769693 14289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfd3b87e0ebd4ad289fbafcd4319f5fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.773871 14416 tablet_bootstrap.cc:492] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:30.774821 14286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243a67c6236549f8902be36013b07bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.781394 14214 tablet_service.cc:1505] Processing CreateTablet for tablet c9215e87872649fd804b48cbf1e2485f (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260201 08:57:30.817663 14281 tablet_service.cc:1505] Processing CreateTablet for tablet c9215e87872649fd804b48cbf1e2485f (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260201 08:57:30.827776 14281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9215e87872649fd804b48cbf1e2485f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.831681 14214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9215e87872649fd804b48cbf1e2485f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.878376 14355 tablet_service.cc:1505] Processing CreateTablet for tablet c9215e87872649fd804b48cbf1e2485f (DEFAULT_TABLE table=test-workload [id=695cdf3e98d0425db2f1358574bab362]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260201 08:57:30.881120 14355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9215e87872649fd804b48cbf1e2485f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:57:30.904606 14416 tablet_bootstrap.cc:654] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:30.927408 14417 tablet_bootstrap.cc:492] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:30.928205 14418 tablet_bootstrap.cc:492] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:30.936654 14416 tablet_bootstrap.cc:492] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:30.937179 14416 ts_tablet_manager.cc:1403] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.164s user 0.006s sys 0.014s
I20260201 08:57:30.962389 14416 raft_consensus.cc:359] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:30.964152 14416 raft_consensus.cc:385] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:30.964522 14416 raft_consensus.cc:740] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:30.964821 14417 tablet_bootstrap.cc:654] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:30.966189 14416 consensus_queue.cc:260] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:30.968369 14418 tablet_bootstrap.cc:654] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:30.969192 14249 heartbeater.cc:499] Master 127.13.194.126:34009 was elected leader, sending a full tablet report...
I20260201 08:57:30.973482 14416 ts_tablet_manager.cc:1434] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.036s user 0.005s sys 0.003s
I20260201 08:57:30.974529 14416 tablet_bootstrap.cc:492] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:30.977768 14417 tablet_bootstrap.cc:492] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:30.978318 14417 ts_tablet_manager.cc:1403] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.010s
I20260201 08:57:30.982024 14418 tablet_bootstrap.cc:492] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:30.982478 14418 ts_tablet_manager.cc:1403] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.056s user 0.011s sys 0.003s
I20260201 08:57:30.983778 14417 raft_consensus.cc:359] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:30.984489 14417 raft_consensus.cc:385] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:30.984797 14417 raft_consensus.cc:740] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:30.985198 14418 raft_consensus.cc:359] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:30.985562 14417 consensus_queue.cc:260] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:30.986042 14418 raft_consensus.cc:385] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:30.987278 14418 raft_consensus.cc:740] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:30.988417 14418 consensus_queue.cc:260] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:30.992089 14416 tablet_bootstrap.cc:654] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:30.998368 14417 ts_tablet_manager.cc:1434] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.020s user 0.004s sys 0.007s
I20260201 08:57:30.998070 14324 heartbeater.cc:499] Master 127.13.194.126:34009 was elected leader, sending a full tablet report...
I20260201 08:57:30.999379 14417 tablet_bootstrap.cc:492] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.003152 14418 ts_tablet_manager.cc:1434] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.020s user 0.009s sys 0.000s
I20260201 08:57:31.004081 14418 tablet_bootstrap.cc:492] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:31.005527 14398 heartbeater.cc:499] Master 127.13.194.126:34009 was elected leader, sending a full tablet report...
I20260201 08:57:31.006538 14417 tablet_bootstrap.cc:654] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.015606 14418 tablet_bootstrap.cc:654] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.028492 14418 tablet_bootstrap.cc:492] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.029079 14418 ts_tablet_manager.cc:1403] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.004s
I20260201 08:57:31.032044 14418 raft_consensus.cc:359] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.032850 14418 raft_consensus.cc:385] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.033210 14418 raft_consensus.cc:740] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.033967 14418 consensus_queue.cc:260] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.036473 14418 ts_tablet_manager.cc:1434] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260201 08:57:31.047130 14418 tablet_bootstrap.cc:492] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
W20260201 08:57:31.048921 14250 tablet.cc:2378] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 08:57:31.055357 14418 tablet_bootstrap.cc:654] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.061388 14416 tablet_bootstrap.cc:492] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.061949 14416 ts_tablet_manager.cc:1403] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.088s user 0.013s sys 0.019s
I20260201 08:57:31.065102 14416 raft_consensus.cc:359] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.065932 14416 raft_consensus.cc:385] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.066249 14416 raft_consensus.cc:740] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.067258 14416 consensus_queue.cc:260] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.069300 14417 tablet_bootstrap.cc:492] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.069753 14417 ts_tablet_manager.cc:1403] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.071s user 0.044s sys 0.022s
I20260201 08:57:31.070209 14416 ts_tablet_manager.cc:1434] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20260201 08:57:31.071098 14416 tablet_bootstrap.cc:492] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:31.072549 14417 raft_consensus.cc:359] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.073351 14417 raft_consensus.cc:385] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.073717 14417 raft_consensus.cc:740] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.074406 14417 consensus_queue.cc:260] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.076977 14417 ts_tablet_manager.cc:1434] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260201 08:57:31.078074 14417 tablet_bootstrap.cc:492] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.078480 14416 tablet_bootstrap.cc:654] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.085275 14417 tablet_bootstrap.cc:654] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.090046 14416 tablet_bootstrap.cc:492] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.090569 14416 ts_tablet_manager.cc:1403] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.020s user 0.007s sys 0.010s
I20260201 08:57:31.094131 14416 raft_consensus.cc:359] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.094888 14416 raft_consensus.cc:385] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.095208 14416 raft_consensus.cc:740] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.095875 14416 consensus_queue.cc:260] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.097895 14417 tablet_bootstrap.cc:492] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.098378 14417 ts_tablet_manager.cc:1403] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.013s
I20260201 08:57:31.098479 14416 ts_tablet_manager.cc:1434] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.008s user 0.000s sys 0.008s
I20260201 08:57:31.099411 14416 tablet_bootstrap.cc:492] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:31.101755 14417 raft_consensus.cc:359] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.102630 14417 raft_consensus.cc:385] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.102917 14417 raft_consensus.cc:740] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.103704 14417 consensus_queue.cc:260] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.106319 14417 ts_tablet_manager.cc:1434] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:57:31.106377 14416 tablet_bootstrap.cc:654] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.107846 14417 tablet_bootstrap.cc:492] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.115329 14417 tablet_bootstrap.cc:654] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.117615 14416 tablet_bootstrap.cc:492] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.118099 14416 ts_tablet_manager.cc:1403] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.004s
I20260201 08:57:31.119215 14423 raft_consensus.cc:493] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.119666 14423 raft_consensus.cc:515] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.120730 14416 raft_consensus.cc:359] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.121418 14416 raft_consensus.cc:385] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.121701 14416 raft_consensus.cc:740] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.122898 14416 consensus_queue.cc:260] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.124552 14423 leader_election.cc:290] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.125510 14416 ts_tablet_manager.cc:1434] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.007s user 0.003s sys 0.005s
I20260201 08:57:31.126493 14416 tablet_bootstrap.cc:492] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:31.132704 14416 tablet_bootstrap.cc:654] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.143603 14418 tablet_bootstrap.cc:492] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.144199 14418 ts_tablet_manager.cc:1403] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.097s user 0.015s sys 0.004s
I20260201 08:57:31.145162 14416 tablet_bootstrap.cc:492] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.145658 14416 ts_tablet_manager.cc:1403] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.007s
I20260201 08:57:31.147131 14418 raft_consensus.cc:359] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.148025 14418 raft_consensus.cc:385] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.148378 14418 raft_consensus.cc:740] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.148270 14416 raft_consensus.cc:359] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.149187 14416 raft_consensus.cc:385] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.149492 14416 raft_consensus.cc:740] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.149477 14418 consensus_queue.cc:260] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.150357 14416 consensus_queue.cc:260] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.151823 14424 raft_consensus.cc:493] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.152256 14424 raft_consensus.cc:515] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.155114 14424 leader_election.cc:290] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.173298 14416 ts_tablet_manager.cc:1434] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.027s user 0.004s sys 0.004s
I20260201 08:57:31.190096 14420 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.190670 14420 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.200024 14420 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.200603 14416 tablet_bootstrap.cc:492] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:31.201196 14417 tablet_bootstrap.cc:492] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.201645 14417 ts_tablet_manager.cc:1403] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.094s user 0.009s sys 0.015s
I20260201 08:57:31.213518 14417 raft_consensus.cc:359] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.214711 14417 raft_consensus.cc:385] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.215023 14417 raft_consensus.cc:740] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.222924 14417 consensus_queue.cc:260] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.224562 14423 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.225114 14423 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.230995 14418 ts_tablet_manager.cc:1434] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.086s user 0.008s sys 0.023s
I20260201 08:57:31.232000 14418 tablet_bootstrap.cc:492] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:31.233470 14423 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.243122 14416 tablet_bootstrap.cc:654] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.245726 14420 raft_consensus.cc:493] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.245066 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.246670 14420 raft_consensus.cc:515] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.247750 14373 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.246613 14372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.250190 14420 leader_election.cc:290] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.252673 14418 tablet_bootstrap.cc:654] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.255683 14423 raft_consensus.cc:493] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.256353 14423 raft_consensus.cc:515] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.257325 14265 leader_election.cc:304] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
W20260201 08:57:31.258595 14265 leader_election.cc:343] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.259265 14423 leader_election.cc:290] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.290719 14423 raft_consensus.cc:2804] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.260687 14372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.296836 14372 raft_consensus.cc:2468] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.262290 14417 ts_tablet_manager.cc:1434] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.060s user 0.009s sys 0.006s
I20260201 08:57:31.296061 14423 raft_consensus.cc:493] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.298288 14265 leader_election.cc:304] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:31.298799 14423 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.301481 14445 raft_consensus.cc:2804] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.303947 14445 raft_consensus.cc:493] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.304490 14445 raft_consensus.cc:3060] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.286743 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.306739 14417 tablet_bootstrap.cc:492] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.315653 14416 tablet_bootstrap.cc:492] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.316155 14416 ts_tablet_manager.cc:1403] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.121s user 0.010s sys 0.006s
I20260201 08:57:31.321201 14416 raft_consensus.cc:359] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.326524 14416 raft_consensus.cc:385] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.333616 14224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.328317 14416 raft_consensus.cc:740] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.336791 14416 consensus_queue.cc:260] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
W20260201 08:57:31.342242 14336 leader_election.cc:343] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.336992 14445 raft_consensus.cc:515] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.343920 14439 raft_consensus.cc:493] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.345065 14224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.345767 14416 ts_tablet_manager.cc:1434] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.029s user 0.002s sys 0.005s
I20260201 08:57:31.346688 14223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.347122 14224 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.347409 14439 raft_consensus.cc:515] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.347424 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.350174 14299 raft_consensus.cc:2393] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 201de2dd2b434ccaa229daddfe43640e in current term 1: Already voted for candidate 414512e4b48344429ac2e37bb4d97d1f in this term.
I20260201 08:57:31.352103 14439 leader_election.cc:290] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.348033 14223 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.357733 14416 tablet_bootstrap.cc:492] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:31.356756 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
W20260201 08:57:31.358754 14262 leader_election.cc:343] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.360239 14224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
W20260201 08:57:31.361011 14339 leader_election.cc:343] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.361366 14224 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 0.
I20260201 08:57:31.362701 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.359862 14418 tablet_bootstrap.cc:492] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.362989 14336 leader_election.cc:304] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters: 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:31.363083 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.363701 14299 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 0.
I20260201 08:57:31.365794 14339 leader_election.cc:304] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e; no voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:31.366618 14262 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters: 201de2dd2b434ccaa229daddfe43640e
I20260201 08:57:31.367199 14439 raft_consensus.cc:2804] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.367244 14424 raft_consensus.cc:3060] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.367692 14439 raft_consensus.cc:493] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.367898 14418 ts_tablet_manager.cc:1403] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.136s user 0.020s sys 0.014s
I20260201 08:57:31.368698 14439 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.372979 14224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.374325 14372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:31.368791 14445 leader_election.cc:290] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.376752 14445 raft_consensus.cc:2804] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.377578 14445 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.377944 14445 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.383785 14439 raft_consensus.cc:515] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.389132 14445 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.390744 14424 raft_consensus.cc:2749] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.392082 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
W20260201 08:57:31.394640 14190 leader_election.cc:343] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:57:31.395843 14265 leader_election.cc:343] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.398968 14420 raft_consensus.cc:493] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.393978 14445 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.399416 14420 raft_consensus.cc:515] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.401643 14416 tablet_bootstrap.cc:654] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.402218 14224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.400362 14423 raft_consensus.cc:515] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.402499 14420 leader_election.cc:290] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.398547 14190 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:31.402999 14224 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.398447 14417 tablet_bootstrap.cc:654] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.403549 14420 raft_consensus.cc:2804] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.408250 14420 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.408656 14420 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.406253 14372 raft_consensus.cc:2468] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.406436 14439 leader_election.cc:290] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.407377 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:31.407997 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.406000 14423 leader_election.cc:290] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.406033 14418 raft_consensus.cc:359] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.411063 14373 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.411249 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:31.417748 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.418565 14222 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.412317 14223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.413369 14418 raft_consensus.cc:385] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260201 08:57:31.418474 14262 leader_election.cc:343] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.420364 14224 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 1.
I20260201 08:57:31.417254 14423 raft_consensus.cc:493] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.422379 14423 raft_consensus.cc:515] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
W20260201 08:57:31.421139 14339 leader_election.cc:343] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.421895 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.421180 14418 raft_consensus.cc:740] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.434949 14370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.427968 14423 leader_election.cc:290] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
W20260201 08:57:31.422818 14190 leader_election.cc:343] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.425467 14420 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.437688 14418 consensus_queue.cc:260] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.439620 14223 raft_consensus.cc:2393] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 414512e4b48344429ac2e37bb4d97d1f in current term 1: Already voted for candidate 42aa5ab3fc4949cb91a209b3125b8423 in this term.
I20260201 08:57:31.436164 14373 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.430315 14369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
W20260201 08:57:31.443477 14190 leader_election.cc:343] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.443820 14265 leader_election.cc:304] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters: 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:31.445639 14418 ts_tablet_manager.cc:1434] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.076s user 0.004s sys 0.005s
I20260201 08:57:31.445458 14265 leader_election.cc:304] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:31.445751 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:31.443898 14190 leader_election.cc:304] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42aa5ab3fc4949cb91a209b3125b8423; no voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:31.447436 14298 raft_consensus.cc:2393] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42aa5ab3fc4949cb91a209b3125b8423 in current term 1: Already voted for candidate 414512e4b48344429ac2e37bb4d97d1f in this term.
I20260201 08:57:31.446671 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.447165 14445 raft_consensus.cc:2804] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.448984 14445 raft_consensus.cc:697] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:31.449724 14445 consensus_queue.cc:237] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.451831 14222 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.447984 14373 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.452714 14420 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.454604 14420 raft_consensus.cc:2749] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.448066 14423 raft_consensus.cc:2804] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.454624 14418 tablet_bootstrap.cc:492] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:31.457552 14417 tablet_bootstrap.cc:492] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.458011 14417 ts_tablet_manager.cc:1403] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.154s user 0.013s sys 0.008s
I20260201 08:57:31.458351 14416 tablet_bootstrap.cc:492] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.459105 14423 raft_consensus.cc:697] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:31.458880 14265 leader_election.cc:304] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:31.459008 14416 ts_tablet_manager.cc:1403] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.105s user 0.007s sys 0.017s
I20260201 08:57:31.461026 14449 raft_consensus.cc:2804] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.461634 14449 raft_consensus.cc:493] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.462049 14449 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.459813 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.462594 14262 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f; no voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:31.459996 14423 consensus_queue.cc:237] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.464102 14222 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.467496 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:31.470834 14416 raft_consensus.cc:359] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.472509 14416 raft_consensus.cc:385] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.476755 14416 raft_consensus.cc:740] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.481449 14416 consensus_queue.cc:260] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
W20260201 08:57:31.476181 14190 leader_election.cc:343] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.479568 14445 raft_consensus.cc:2749] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.486977 14416 ts_tablet_manager.cc:1434] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.026s user 0.006s sys 0.002s
I20260201 08:57:31.488173 14449 raft_consensus.cc:515] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.487888 14417 raft_consensus.cc:359] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
W20260201 08:57:31.489145 14190 leader_election.cc:343] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.490219 14190 leader_election.cc:304] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42aa5ab3fc4949cb91a209b3125b8423; no voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:31.490788 14417 raft_consensus.cc:385] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.490948 14452 raft_consensus.cc:2749] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.491154 14417 raft_consensus.cc:740] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.489698 14416 tablet_bootstrap.cc:492] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:31.492147 14417 consensus_queue.cc:260] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.493937 14449 leader_election.cc:290] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.494308 14418 tablet_bootstrap.cc:654] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
W20260201 08:57:31.491158 14190 leader_election.cc:343] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:57:31.495676 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:31.495949 14417 ts_tablet_manager.cc:1434] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.038s user 0.002s sys 0.007s
I20260201 08:57:31.496251 14373 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.495536 14190 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42aa5ab3fc4949cb91a209b3125b8423; no voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:31.496949 14417 tablet_bootstrap.cc:492] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.496986 14452 raft_consensus.cc:2749] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.501897 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.502660 14222 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.505424 14416 tablet_bootstrap.cc:654] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.507408 14373 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.508569 14265 leader_election.cc:304] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:31.509517 14454 raft_consensus.cc:2804] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.510075 14454 raft_consensus.cc:697] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:31.510141 14222 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.511775 14454 consensus_queue.cc:237] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.516192 14417 tablet_bootstrap.cc:654] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.517068 14416 tablet_bootstrap.cc:492] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.517525 14416 ts_tablet_manager.cc:1403] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.003s
I20260201 08:57:31.518319 14336 leader_election.cc:304] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters: 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:31.519156 14439 raft_consensus.cc:2804] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.519675 14439 raft_consensus.cc:697] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:31.520473 14439 consensus_queue.cc:237] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
W20260201 08:57:31.519232 14336 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:41853, user_credentials={real_user=slave}} blocked reactor thread for 96842us
I20260201 08:57:31.525117 14416 raft_consensus.cc:359] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.526044 14416 raft_consensus.cc:385] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.526299 14416 raft_consensus.cc:740] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.526924 14416 consensus_queue.cc:260] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.529382 14416 ts_tablet_manager.cc:1434] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260201 08:57:31.530141 14418 tablet_bootstrap.cc:492] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.530930 14418 ts_tablet_manager.cc:1403] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.009s
I20260201 08:57:31.530213 14121 catalog_manager.cc:5654] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 1 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:31.532131 14416 tablet_bootstrap.cc:492] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423: Bootstrap starting.
I20260201 08:57:31.536289 14418 raft_consensus.cc:359] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.540812 14418 raft_consensus.cc:385] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.541147 14418 raft_consensus.cc:740] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.544909 14120 catalog_manager.cc:5654] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 0 to 1, leader changed from <none> to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 1 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:31.545814 14418 consensus_queue.cc:260] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.555146 14416 tablet_bootstrap.cc:654] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.559082 14417 tablet_bootstrap.cc:492] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.559638 14417 ts_tablet_manager.cc:1403] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.008s
I20260201 08:57:31.560763 14418 ts_tablet_manager.cc:1434] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.030s user 0.005s sys 0.003s
I20260201 08:57:31.561933 14418 tablet_bootstrap.cc:492] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:31.562641 14417 raft_consensus.cc:359] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.563445 14417 raft_consensus.cc:385] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.563740 14417 raft_consensus.cc:740] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.564481 14417 consensus_queue.cc:260] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.570202 14418 tablet_bootstrap.cc:654] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.572131 14417 ts_tablet_manager.cc:1434] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260201 08:57:31.572813 14416 tablet_bootstrap.cc:492] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423: No bootstrap required, opened a new log
I20260201 08:57:31.573113 14417 tablet_bootstrap.cc:492] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.573362 14416 ts_tablet_manager.cc:1403] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423: Time spent bootstrapping tablet: real 0.041s user 0.012s sys 0.011s
I20260201 08:57:31.576340 14416 raft_consensus.cc:359] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.576998 14416 raft_consensus.cc:385] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.577265 14416 raft_consensus.cc:740] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.577972 14416 consensus_queue.cc:260] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.582341 14416 ts_tablet_manager.cc:1434] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260201 08:57:31.584669 14418 tablet_bootstrap.cc:492] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.585198 14418 ts_tablet_manager.cc:1403] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.008s
I20260201 08:57:31.581303 14417 tablet_bootstrap.cc:654] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.590374 14418 raft_consensus.cc:359] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.591157 14418 raft_consensus.cc:385] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.591486 14418 raft_consensus.cc:740] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.592312 14418 consensus_queue.cc:260] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.595458 14418 ts_tablet_manager.cc:1434] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260201 08:57:31.596419 14418 tablet_bootstrap.cc:492] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:31.603662 14418 tablet_bootstrap.cc:654] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.604661 14417 tablet_bootstrap.cc:492] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.605283 14417 ts_tablet_manager.cc:1403] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.000s
I20260201 08:57:31.605532 14121 catalog_manager.cc:5654] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 1 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:31.607517 14121 catalog_manager.cc:5654] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 1 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:31.608131 14417 raft_consensus.cc:359] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.608764 14417 raft_consensus.cc:385] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.609038 14417 raft_consensus.cc:740] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.609591 14417 consensus_queue.cc:260] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.611939 14417 ts_tablet_manager.cc:1434] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:57:31.615053 14417 tablet_bootstrap.cc:492] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.624727 14417 tablet_bootstrap.cc:654] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.631587 14418 tablet_bootstrap.cc:492] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.633088 14418 ts_tablet_manager.cc:1403] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.037s user 0.023s sys 0.011s
I20260201 08:57:31.635607 14418 raft_consensus.cc:359] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.636294 14418 raft_consensus.cc:385] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.636564 14418 raft_consensus.cc:740] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.637221 14418 consensus_queue.cc:260] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.639539 14418 ts_tablet_manager.cc:1434] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260201 08:57:31.640466 14418 tablet_bootstrap.cc:492] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:31.643808 14417 tablet_bootstrap.cc:492] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.644232 14417 ts_tablet_manager.cc:1403] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.014s
I20260201 08:57:31.646466 14417 raft_consensus.cc:359] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.647099 14417 raft_consensus.cc:385] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.647368 14417 raft_consensus.cc:740] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.647541 14418 tablet_bootstrap.cc:654] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.648085 14417 consensus_queue.cc:260] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.652595 14417 ts_tablet_manager.cc:1434] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260201 08:57:31.653509 14417 tablet_bootstrap.cc:492] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f: Bootstrap starting.
I20260201 08:57:31.657346 14418 tablet_bootstrap.cc:492] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.657816 14418 ts_tablet_manager.cc:1403] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.000s
I20260201 08:57:31.660213 14418 raft_consensus.cc:359] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.660851 14418 raft_consensus.cc:385] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.661149 14418 raft_consensus.cc:740] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.661736 14417 tablet_bootstrap.cc:654] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.661725 14418 consensus_queue.cc:260] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.664134 14418 ts_tablet_manager.cc:1434] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:57:31.664991 14454 raft_consensus.cc:493] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.665096 14418 tablet_bootstrap.cc:492] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e: Bootstrap starting.
I20260201 08:57:31.665498 14454 raft_consensus.cc:515] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.667905 14454 leader_election.cc:290] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.670562 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2686011f0c67477890ba751b5bdee121" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.671229 14222 raft_consensus.cc:2468] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.672566 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2686011f0c67477890ba751b5bdee121" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.672989 14262 leader_election.cc:304] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:31.673208 14373 raft_consensus.cc:2468] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.674867 14454 raft_consensus.cc:2804] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.675217 14454 raft_consensus.cc:493] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.675539 14454 raft_consensus.cc:3060] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.673004 14418 tablet_bootstrap.cc:654] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e: Neither blocks nor log segments found. Creating new log.
I20260201 08:57:31.678445 14417 tablet_bootstrap.cc:492] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f: No bootstrap required, opened a new log
I20260201 08:57:31.678972 14417 ts_tablet_manager.cc:1403] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.005s
I20260201 08:57:31.681576 14417 raft_consensus.cc:359] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.682344 14417 raft_consensus.cc:385] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.682655 14417 raft_consensus.cc:740] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.683531 14417 consensus_queue.cc:260] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.685992 14417 ts_tablet_manager.cc:1434] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:57:31.687079 14418 tablet_bootstrap.cc:492] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e: No bootstrap required, opened a new log
I20260201 08:57:31.687500 14418 ts_tablet_manager.cc:1403] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.007s
I20260201 08:57:31.690199 14454 raft_consensus.cc:515] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.690335 14418 raft_consensus.cc:359] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.691026 14418 raft_consensus.cc:385] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:57:31.691287 14418 raft_consensus.cc:740] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Initialized, Role: FOLLOWER
I20260201 08:57:31.692104 14454 leader_election.cc:290] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.691898 14418 consensus_queue.cc:260] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.692723 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2686011f0c67477890ba751b5bdee121" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.693282 14222 raft_consensus.cc:3060] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.693264 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2686011f0c67477890ba751b5bdee121" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:31.693885 14418 ts_tablet_manager.cc:1434] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260201 08:57:31.693964 14373 raft_consensus.cc:3060] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.700356 14222 raft_consensus.cc:2468] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.701577 14373 raft_consensus.cc:2468] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.701529 14262 leader_election.cc:304] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:31.702699 14454 raft_consensus.cc:2804] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.703320 14454 raft_consensus.cc:697] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:31.705394 14454 consensus_queue.cc:237] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.713930 14120 catalog_manager.cc:5654] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 1 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
W20260201 08:57:31.738129 14168 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:57:31.766919 14439 raft_consensus.cc:493] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.767648 14439 raft_consensus.cc:515] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.769945 14439 leader_election.cc:290] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.770890 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.770813 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.771528 14298 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 0.
I20260201 08:57:31.771569 14222 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 0.
I20260201 08:57:31.772784 14336 leader_election.cc:304] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:31.773569 14439 raft_consensus.cc:2804] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.773846 14439 raft_consensus.cc:493] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.774143 14439 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.779446 14439 raft_consensus.cc:515] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.781453 14439 leader_election.cc:290] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.783962 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:31.784539 14298 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.784312 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.785195 14222 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.791321 14298 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 1.
I20260201 08:57:31.791841 14222 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 1.
I20260201 08:57:31.792567 14339 leader_election.cc:304] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:31.793470 14439 raft_consensus.cc:2804] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.793944 14439 raft_consensus.cc:697] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:31.794806 14439 consensus_queue.cc:237] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.797694 14424 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.798288 14424 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.800143 14424 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.801602 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.802024 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.802364 14222 raft_consensus.cc:2393] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 201de2dd2b434ccaa229daddfe43640e in current term 1: Already voted for candidate 42aa5ab3fc4949cb91a209b3125b8423 in this term.
I20260201 08:57:31.802726 14298 raft_consensus.cc:2393] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 201de2dd2b434ccaa229daddfe43640e in current term 1: Already voted for candidate 414512e4b48344429ac2e37bb4d97d1f in this term.
I20260201 08:57:31.803952 14120 catalog_manager.cc:5654] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 0 to 1, leader changed from <none> to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 1 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:31.805661 14339 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e; no voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:31.806290 14424 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.812249 14424 raft_consensus.cc:2749] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.831560 14454 raft_consensus.cc:493] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.832048 14454 raft_consensus.cc:515] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.833811 14454 leader_election.cc:290] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.834636 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.834813 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.835342 14373 raft_consensus.cc:2468] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.835371 14222 raft_consensus.cc:2468] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 0.
I20260201 08:57:31.836498 14265 leader_election.cc:304] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:31.837201 14454 raft_consensus.cc:2804] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.837576 14454 raft_consensus.cc:493] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.837893 14454 raft_consensus.cc:3060] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.844980 14454 raft_consensus.cc:515] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.846879 14454 leader_election.cc:290] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.847683 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.848160 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:31.848260 14222 raft_consensus.cc:3060] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.848623 14373 raft_consensus.cc:3060] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.853245 14373 raft_consensus.cc:2468] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.854108 14265 leader_election.cc:304] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:31.854955 14222 raft_consensus.cc:2468] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 1.
I20260201 08:57:31.855113 14454 raft_consensus.cc:2804] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.855594 14454 raft_consensus.cc:697] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:31.856377 14454 consensus_queue.cc:237] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.864162 14120 catalog_manager.cc:5654] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 1 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:31.878168 14424 raft_consensus.cc:493] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.878619 14424 raft_consensus.cc:515] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.880193 14424 leader_election.cc:290] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.881011 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.881268 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.881652 14222 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 0.
I20260201 08:57:31.881816 14298 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 0.
I20260201 08:57:31.882619 14336 leader_election.cc:304] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:31.883410 14424 raft_consensus.cc:2804] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:57:31.883720 14424 raft_consensus.cc:493] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:31.883965 14424 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.888042 14424 raft_consensus.cc:515] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.889545 14424 leader_election.cc:290] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:31.890143 14452 raft_consensus.cc:493] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.890349 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:31.890611 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:31.890589 14452 raft_consensus.cc:515] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.890925 14222 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.891248 14298 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.892578 14452 leader_election.cc:290] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.894881 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:31.896178 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5a1230fe64d426190770e7c042ef14b" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.897001 14373 raft_consensus.cc:2393] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42aa5ab3fc4949cb91a209b3125b8423 in current term 1: Already voted for candidate 414512e4b48344429ac2e37bb4d97d1f in this term.
I20260201 08:57:31.898169 14298 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 1.
I20260201 08:57:31.898481 14222 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 1.
I20260201 08:57:31.898612 14190 leader_election.cc:304] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42aa5ab3fc4949cb91a209b3125b8423; no voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:31.899696 14336 leader_election.cc:304] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:31.900223 14452 raft_consensus.cc:3060] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.900681 14424 raft_consensus.cc:2804] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:57:31.901072 14424 raft_consensus.cc:697] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:31.901841 14424 consensus_queue.cc:237] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.907373 14452 raft_consensus.cc:2749] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.909905 14120 catalog_manager.cc:5654] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 0 to 1, leader changed from <none> to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 1 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:31.914683 14445 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:31.917193 14445 consensus_queue.cc:1048] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:31.913487 14454 consensus_queue.cc:1048] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260201 08:57:31.924405 14449 consensus_queue.cc:1048] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:31.925781 14449 raft_consensus.cc:493] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:31.926246 14449 raft_consensus.cc:515] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:31.928184 14449 leader_election.cc:290] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:31.930331 14224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423" is_pre_election: true
I20260201 08:57:31.931133 14224 raft_consensus.cc:2393] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 414512e4b48344429ac2e37bb4d97d1f in current term 1: Already voted for candidate 201de2dd2b434ccaa229daddfe43640e in this term.
I20260201 08:57:31.933917 14372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:31.935593 14265 leader_election.cc:304] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f; no voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:31.936800 14454 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:57:31.951192 14454 raft_consensus.cc:2749] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:57:31.983436 14445 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.006312 14423 consensus_queue.cc:1048] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.030571 14424 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.041116 14424 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.175987 14423 consensus_queue.cc:1048] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.187397 14423 consensus_queue.cc:1048] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.290745 14489 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.301100 14424 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.338058 14424 consensus_queue.cc:1048] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.350482 14424 consensus_queue.cc:1048] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.377671 14423 consensus_queue.cc:1048] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:32.389176 14423 consensus_queue.cc:1048] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 08:57:32.741304 14168 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:57:33.115196 14499 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:57:33.115624 14499 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.117297 14499 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:33.117982 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f" is_pre_election: true
I20260201 08:57:33.118235 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e" is_pre_election: true
I20260201 08:57:33.118501 14298 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 1.
I20260201 08:57:33.118810 14371 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 1.
I20260201 08:57:33.119508 14190 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.120092 14499 raft_consensus.cc:2804] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:57:33.120345 14499 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:57:33.120590 14499 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.125216 14499 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.126870 14499 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:33.127446 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:33.127758 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:33.127980 14298 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.128283 14371 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.132675 14298 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.132781 14371 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.133737 14190 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.134330 14499 raft_consensus.cc:2804] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:33.135169 14499 raft_consensus.cc:697] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Leader. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:33.135973 14499 consensus_queue.cc:237] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.142805 14119 catalog_manager.cc:5654] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 reported cstate change: term changed from 0 to 2, leader changed from <none> to 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:33.291520 14298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:47564
I20260201 08:57:33.292061 14298 raft_consensus.cc:606] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Received request to transfer leadership to TS 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:33.303639 14371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
mode: GRACEFUL
new_leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:48398
I20260201 08:57:33.304116 14371 raft_consensus.cc:606] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Received request to transfer leadership to TS 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:33.310791 14298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "243a67c6236549f8902be36013b07bd1"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:47564
I20260201 08:57:33.311317 14298 raft_consensus.cc:606] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Received request to transfer leadership to TS 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:33.315282 14371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
mode: GRACEFUL
new_leader_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:48398
I20260201 08:57:33.315729 14371 raft_consensus.cc:606] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Received request to transfer leadership to TS 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:33.319612 14371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
mode: GRACEFUL
new_leader_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:48398
I20260201 08:57:33.320092 14371 raft_consensus.cc:606] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Received request to transfer leadership to TS 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:33.328804 14298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:47564
I20260201 08:57:33.329360 14298 raft_consensus.cc:606] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Received request to transfer leadership to TS 201de2dd2b434ccaa229daddfe43640e
I20260201 08:57:33.449062 14424 raft_consensus.cc:993] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: : Instructing follower 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:33.449473 14509 raft_consensus.cc:1081] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Signalling peer 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:33.450950 14298 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:47538
I20260201 08:57:33.451433 14298 raft_consensus.cc:493] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:33.451702 14298 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.456136 14298 raft_consensus.cc:515] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.457799 14298 leader_election.cc:290] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 2 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:33.458683 14223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:33.458967 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:33.459319 14223 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.459496 14371 raft_consensus.cc:3055] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:57:33.459858 14371 raft_consensus.cc:740] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:33.460592 14371 consensus_queue.cc:260] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.462129 14424 raft_consensus.cc:993] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e: : Instructing follower 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:33.462181 14371 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.462713 14424 raft_consensus.cc:1081] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Signalling peer 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:33.464359 14298 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:47538
I20260201 08:57:33.464926 14298 raft_consensus.cc:493] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:33.465291 14223 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 2.
I20260201 08:57:33.465286 14298 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.466331 14262 leader_election.cc:304] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.466943 14423 raft_consensus.cc:2804] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:33.468446 14371 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 2.
I20260201 08:57:33.469375 14423 raft_consensus.cc:697] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:33.470232 14423 consensus_queue.cc:237] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.471483 14298 raft_consensus.cc:515] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.473228 14298 leader_election.cc:290] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 2 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:33.474618 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:33.475188 14371 raft_consensus.cc:3055] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:57:33.475502 14371 raft_consensus.cc:740] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:33.476083 14223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:33.476622 14223 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.476235 14371 consensus_queue.cc:260] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.477479 14371 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.477810 14119 catalog_manager.cc:5654] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 1 to 2, leader changed from 201de2dd2b434ccaa229daddfe43640e (127.13.194.67) to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 2 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:33.478708 14423 raft_consensus.cc:993] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:33.479194 14423 raft_consensus.cc:1081] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Signalling peer 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:33.480695 14222 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "243a67c6236549f8902be36013b07bd1"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:39314
I20260201 08:57:33.481257 14222 raft_consensus.cc:493] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:33.481583 14222 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.483506 14223 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 2.
I20260201 08:57:33.484494 14262 leader_election.cc:304] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.485535 14371 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 2.
I20260201 08:57:33.487587 14222 raft_consensus.cc:515] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.489454 14222 leader_election.cc:290] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:33.489840 14423 raft_consensus.cc:2804] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:33.490866 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:33.490983 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:33.491554 14298 raft_consensus.cc:3055] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:57:33.491591 14371 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.492153 14298 raft_consensus.cc:740] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:33.490294 14423 raft_consensus.cc:697] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:33.493371 14298 consensus_queue.cc:260] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.493512 14423 consensus_queue.cc:237] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.494542 14298 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.499961 14298 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.500439 14371 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.500934 14190 leader_election.cc:304] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.501650 14499 raft_consensus.cc:2804] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:33.502141 14499 raft_consensus.cc:697] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Leader. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:33.501996 14119 catalog_manager.cc:5654] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 1 to 2, leader changed from 201de2dd2b434ccaa229daddfe43640e (127.13.194.67) to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 2 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:33.502907 14499 consensus_queue.cc:237] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.510140 14120 catalog_manager.cc:5654] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 reported cstate change: term changed from 1 to 2, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:33.524555 14371 raft_consensus.cc:1275] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260201 08:57:33.525661 14499 consensus_queue.cc:1048] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:33.536898 14298 raft_consensus.cc:1275] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260201 08:57:33.538554 14499 consensus_queue.cc:1048] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:57:33.584750 14424 raft_consensus.cc:993] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e: : Instructing follower 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:33.585175 14509 raft_consensus.cc:1081] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Signalling peer 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:33.586364 14222 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:39330
I20260201 08:57:33.586787 14222 raft_consensus.cc:493] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:33.587056 14222 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.591858 14222 raft_consensus.cc:515] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.593364 14222 leader_election.cc:290] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:33.594506 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:33.594506 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:33.595155 14371 raft_consensus.cc:3055] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:57:33.595297 14298 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.595504 14371 raft_consensus.cc:740] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:33.596292 14371 consensus_queue.cc:260] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.597262 14371 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.600044 14298 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.600937 14190 leader_election.cc:304] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.601600 14371 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.601625 14499 raft_consensus.cc:2804] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:33.602303 14499 raft_consensus.cc:697] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Leader. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:33.603070 14499 consensus_queue.cc:237] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.609249 14120 catalog_manager.cc:5654] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 reported cstate change: term changed from 1 to 2, leader changed from 201de2dd2b434ccaa229daddfe43640e (127.13.194.67) to 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:33.696689 14512 raft_consensus.cc:993] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:33.697132 14423 raft_consensus.cc:1081] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Signalling peer 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:33.698350 14371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:48370
I20260201 08:57:33.698778 14371 raft_consensus.cc:493] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:33.699061 14371 raft_consensus.cc:3060] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.702409 14512 raft_consensus.cc:993] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:33.702772 14423 raft_consensus.cc:1081] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Signalling peer 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:33.704079 14222 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:39314
I20260201 08:57:33.704180 14371 raft_consensus.cc:515] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.704501 14222 raft_consensus.cc:493] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:33.704878 14222 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.705878 14371 leader_election.cc:290] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 2 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:33.706662 14223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:33.707103 14223 raft_consensus.cc:3060] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.707301 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9215e87872649fd804b48cbf1e2485f" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:33.707860 14298 raft_consensus.cc:3055] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:57:33.708142 14298 raft_consensus.cc:740] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:33.708721 14298 consensus_queue.cc:260] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.709617 14298 raft_consensus.cc:3060] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.712975 14223 raft_consensus.cc:2468] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 2.
I20260201 08:57:33.713979 14336 leader_election.cc:304] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.714093 14298 raft_consensus.cc:2468] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 2.
I20260201 08:57:33.714095 14222 raft_consensus.cc:515] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.714756 14509 raft_consensus.cc:2804] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:33.715219 14509 raft_consensus.cc:697] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 2 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:33.716189 14222 leader_election.cc:290] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:33.715904 14509 consensus_queue.cc:237] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.716950 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:33.717182 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:33.717500 14298 raft_consensus.cc:3055] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:57:33.717664 14371 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.717829 14298 raft_consensus.cc:740] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:33.719074 14298 consensus_queue.cc:260] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.721799 14298 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:33.723800 14120 catalog_manager.cc:5654] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 1 to 2, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 2 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:33.724433 14371 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.725421 14190 leader_election.cc:304] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:33.726153 14499 raft_consensus.cc:2804] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:33.726122 14298 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:33.726706 14499 raft_consensus.cc:697] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Leader. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:33.727492 14499 consensus_queue.cc:237] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:33.734009 14120 catalog_manager.cc:5654] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 reported cstate change: term changed from 1 to 2, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:33.916314 14371 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:33.917501 14423 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:33.917833 14371 raft_consensus.cc:1275] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:33.918947 14499 consensus_queue.cc:1048] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:33.925767 14222 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:33.928946 14526 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:33.932578 14222 raft_consensus.cc:1275] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:33.934008 14298 raft_consensus.cc:1275] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:33.934026 14510 consensus_queue.cc:1048] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:57:33.938462 14500 consensus_queue.cc:1048] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:33.950268 14373 raft_consensus.cc:1275] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:33.951444 14512 consensus_queue.cc:1048] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:34.126206 14373 raft_consensus.cc:1275] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:34.127308 14517 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:34.135313 14298 raft_consensus.cc:1275] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:34.137539 14517 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:34.174422 14223 raft_consensus.cc:1275] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:34.175447 14509 consensus_queue.cc:1048] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:34.183611 14298 raft_consensus.cc:1275] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:34.185232 14509 consensus_queue.cc:1048] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:34.251783 14373 raft_consensus.cc:1275] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:34.253687 14517 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:34.262480 14298 raft_consensus.cc:1275] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:34.264978 14500 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:36.356727 14089 auto_leader_rebalancer-test.cc:272] The leader distribution is
I20260201 08:57:36.357434 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:36.375763 14223 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
mode: GRACEFUL
new_leader_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:39342
I20260201 08:57:36.376223 14223 raft_consensus.cc:606] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Received request to transfer leadership to TS 201de2dd2b434ccaa229daddfe43640e
I20260201 08:57:36.385517 14298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:47576
I20260201 08:57:36.385975 14298 raft_consensus.cc:606] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Received request to transfer leadership to TS 201de2dd2b434ccaa229daddfe43640e
I20260201 08:57:36.386965 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260201 08:57:36.387370 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:36.481021 14541 raft_consensus.cc:993] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:36.481407 14545 raft_consensus.cc:1081] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Signalling peer 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:36.482759 14373 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:48370
I20260201 08:57:36.483196 14373 raft_consensus.cc:493] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:36.483471 14373 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:36.487982 14373 raft_consensus.cc:515] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:36.489485 14373 leader_election.cc:290] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 3 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:36.490373 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:36.490347 14223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:36.491007 14298 raft_consensus.cc:3055] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:57:36.491083 14223 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:36.491266 14298 raft_consensus.cc:740] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:36.491883 14298 consensus_queue.cc:260] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:36.492681 14298 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:36.496166 14223 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 3.
I20260201 08:57:36.496323 14298 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 3.
I20260201 08:57:36.497262 14336 leader_election.cc:304] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:36.498162 14540 raft_consensus.cc:2804] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:57:36.498634 14540 raft_consensus.cc:697] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:36.499332 14540 consensus_queue.cc:237] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:36.506910 14119 catalog_manager.cc:5654] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 2 to 3, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 3 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:36.776605 14552 raft_consensus.cc:993] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423: : Instructing follower 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:36.777136 14499 raft_consensus.cc:1081] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Signalling peer 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:36.779102 14373 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:48386
I20260201 08:57:36.779567 14373 raft_consensus.cc:493] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:36.779892 14373 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:36.786067 14373 raft_consensus.cc:515] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:36.787446 14373 leader_election.cc:290] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 3 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:36.788342 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:36.788295 14223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:36.788880 14298 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:36.788967 14223 raft_consensus.cc:3055] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:57:36.789287 14223 raft_consensus.cc:740] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:36.790339 14223 consensus_queue.cc:260] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:36.791199 14223 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:36.792757 14298 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 3.
I20260201 08:57:36.793640 14339 leader_election.cc:304] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:36.794246 14540 raft_consensus.cc:2804] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:57:36.794601 14540 raft_consensus.cc:697] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:36.795239 14540 consensus_queue.cc:237] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:36.796669 14223 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 3.
I20260201 08:57:36.802389 14119 catalog_manager.cc:5654] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 2 to 3, leader changed from 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65) to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 3 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:36.991539 14298 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:36.992626 14540 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:37.003299 14223 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:37.004534 14540 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:37.328027 14223 raft_consensus.cc:1275] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:37.329160 14540 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:37.337811 14298 raft_consensus.cc:1275] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:37.340591 14557 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:37.388118 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:37.392788 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:37.393214 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:38.394168 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:38.399432 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:38.399780 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:39.400756 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:39.406512 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:39.406853 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:40.407646 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:40.412474 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:40.412907 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:41.413751 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:41.418385 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:41.418779 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:42.419626 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:42.424263 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:42.424662 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:43.425495 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:43.430421 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:43.430761 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:44.431560 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:44.436597 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:44.437008 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:45.437844 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:45.442780 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:45.443177 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:46.468760 14089 auto_leader_rebalancer-test.cc:291] The leader distribution is
I20260201 08:57:46.472832 14371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
mode: GRACEFUL
new_leader_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:48398
I20260201 08:57:46.473438 14371 raft_consensus.cc:606] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Received request to transfer leadership to TS 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:46.490108 14222 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
mode: GRACEFUL
new_leader_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:59984
I20260201 08:57:46.490566 14222 raft_consensus.cc:606] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Received request to transfer leadership to TS 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:46.494773 14222 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
mode: GRACEFUL
new_leader_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:59984
I20260201 08:57:46.495203 14222 raft_consensus.cc:606] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Received request to transfer leadership to TS 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:46.499141 14222 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "243a67c6236549f8902be36013b07bd1"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
mode: GRACEFUL
new_leader_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:59984
I20260201 08:57:46.499532 14222 raft_consensus.cc:606] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Received request to transfer leadership to TS 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:46.503423 14371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
mode: GRACEFUL
new_leader_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:48398
I20260201 08:57:46.503806 14371 raft_consensus.cc:606] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Received request to transfer leadership to TS 414512e4b48344429ac2e37bb4d97d1f
I20260201 08:57:46.507500 14565 raft_consensus.cc:993] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e: : Instructing follower 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.508056 14571 raft_consensus.cc:1081] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Signalling peer 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.509624 14299 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:47538
I20260201 08:57:46.510099 14299 raft_consensus.cc:493] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:46.510516 14299 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:46.516202 14299 raft_consensus.cc:515] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.519011 14299 leader_election.cc:290] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 4 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:46.519655 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:46.520260 14222 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:46.521164 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dfd3b87e0ebd4ad289fbafcd4319f5fd" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:46.521584 14371 raft_consensus.cc:3055] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:57:46.521811 14371 raft_consensus.cc:740] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:46.522400 14371 consensus_queue.cc:260] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.523205 14371 raft_consensus.cc:3060] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:46.524405 14222 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 4.
I20260201 08:57:46.525485 14262 leader_election.cc:304] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:46.526341 14563 raft_consensus.cc:2804] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:57:46.527245 14563 raft_consensus.cc:697] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 4 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:46.528148 14371 raft_consensus.cc:2468] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 4.
I20260201 08:57:46.528080 14563 consensus_queue.cc:237] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.534528 14119 catalog_manager.cc:5654] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 3 to 4, leader changed from 201de2dd2b434ccaa229daddfe43640e (127.13.194.67) to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 4 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:46.655381 14499 raft_consensus.cc:993] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423: : Instructing follower 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.655824 14578 raft_consensus.cc:1081] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Signalling peer 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.657090 14299 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "243a67c6236549f8902be36013b07bd1"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:47554
I20260201 08:57:46.657531 14299 raft_consensus.cc:493] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:46.657799 14299 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.662778 14299 raft_consensus.cc:515] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.664587 14299 leader_election.cc:290] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 3 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:46.665433 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:46.665719 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243a67c6236549f8902be36013b07bd1" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:46.665963 14222 raft_consensus.cc:3055] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:57:46.666188 14371 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.666270 14222 raft_consensus.cc:740] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:46.667002 14222 consensus_queue.cc:260] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.668133 14222 raft_consensus.cc:3060] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.672122 14371 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 3.
I20260201 08:57:46.673177 14265 leader_election.cc:304] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:46.673621 14222 raft_consensus.cc:2468] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 3.
I20260201 08:57:46.673767 14563 raft_consensus.cc:2804] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:57:46.674214 14563 raft_consensus.cc:697] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:46.675019 14563 consensus_queue.cc:237] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.681300 14119 catalog_manager.cc:5654] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 2 to 3, leader changed from 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65) to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 3 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:46.737535 14499 raft_consensus.cc:993] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423: : Instructing follower 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.737906 14578 raft_consensus.cc:1081] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Signalling peer 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.739217 14299 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:47554
I20260201 08:57:46.739643 14299 raft_consensus.cc:493] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:46.739883 14299 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.744167 14299 raft_consensus.cc:515] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.745847 14299 leader_election.cc:290] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 3 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:46.746469 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:46.746976 14222 raft_consensus.cc:3055] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:57:46.747001 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:46.747331 14499 raft_consensus.cc:993] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: : Instructing follower 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.747536 14222 raft_consensus.cc:740] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:46.747718 14371 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.747828 14578 raft_consensus.cc:1081] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Signalling peer 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.748328 14222 consensus_queue.cc:260] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.749385 14222 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.749320 14299 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:47554
I20260201 08:57:46.749956 14299 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:46.750295 14299 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.753367 14222 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 3.
I20260201 08:57:46.753556 14371 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 3.
I20260201 08:57:46.754259 14262 leader_election.cc:304] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:46.755015 14563 raft_consensus.cc:2804] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:57:46.755432 14563 raft_consensus.cc:697] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:46.756213 14563 consensus_queue.cc:237] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.756292 14299 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.757810 14299 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 3 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:46.758617 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:46.759294 14222 raft_consensus.cc:3055] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:57:46.759598 14222 raft_consensus.cc:740] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:46.760403 14222 consensus_queue.cc:260] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.758657 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:46.761536 14222 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.761543 14371 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:46.762933 14565 raft_consensus.cc:993] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: : Instructing follower 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.763361 14571 raft_consensus.cc:1081] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Signalling peer 414512e4b48344429ac2e37bb4d97d1f to start an election
I20260201 08:57:46.764050 14119 catalog_manager.cc:5654] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 2 to 3, leader changed from 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65) to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 3 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:46.764914 14299 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
from {username='slave'} at 127.0.0.1:47538
I20260201 08:57:46.765460 14299 raft_consensus.cc:493] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:46.765787 14299 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:46.768277 14371 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 3.
I20260201 08:57:46.769361 14265 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 414512e4b48344429ac2e37bb4d97d1f; no voters:
I20260201 08:57:46.770143 14563 raft_consensus.cc:2804] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:57:46.770622 14563 raft_consensus.cc:697] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:46.770385 14222 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 3.
I20260201 08:57:46.771526 14563 consensus_queue.cc:237] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.772207 14299 raft_consensus.cc:515] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.774441 14299 leader_election.cc:290] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 4 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:46.774922 14371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:46.775017 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "414512e4b48344429ac2e37bb4d97d1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:46.775498 14371 raft_consensus.cc:3055] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:57:46.775593 14222 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:46.775838 14371 raft_consensus.cc:740] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:46.776546 14371 consensus_queue.cc:260] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.777652 14371 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:46.781468 14222 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 4.
I20260201 08:57:46.782529 14262 leader_election.cc:304] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 414512e4b48344429ac2e37bb4d97d1f, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:46.783393 14563 raft_consensus.cc:2804] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:57:46.783855 14563 raft_consensus.cc:697] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 LEADER]: Becoming Leader. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:46.784767 14371 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 414512e4b48344429ac2e37bb4d97d1f in term 4.
I20260201 08:57:46.784631 14563 consensus_queue.cc:237] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:46.786326 14119 catalog_manager.cc:5654] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 2 to 3, leader changed from 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65) to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 3 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:46.796355 14119 catalog_manager.cc:5654] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f reported cstate change: term changed from 3 to 4, leader changed from 201de2dd2b434ccaa229daddfe43640e (127.13.194.67) to 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66). New cstate: current_term: 4 leader_uuid: "414512e4b48344429ac2e37bb4d97d1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:46.927598 14371 raft_consensus.cc:1275] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:57:46.928697 14563 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:57:46.937749 14224 raft_consensus.cc:1275] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:57:46.939509 14572 consensus_queue.cc:1048] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:57:47.071597 14371 raft_consensus.cc:1275] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:47.073098 14224 raft_consensus.cc:1275] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:47.072968 14586 consensus_queue.cc:1048] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:57:47.074254 14586 consensus_queue.cc:1048] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:47.136201 14371 raft_consensus.cc:1275] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:47.137276 14591 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:47.144937 14224 raft_consensus.cc:1275] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:47.146494 14586 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:47.168601 14224 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:57:47.169689 14586 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:57:47.178049 14371 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:57:47.179621 14586 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:57:47.301128 14224 raft_consensus.cc:1275] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:57:47.302398 14586 consensus_queue.cc:1048] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:47.311127 14371 raft_consensus.cc:1275] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Refusing update from remote peer 414512e4b48344429ac2e37bb4d97d1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:57:47.312665 14586 consensus_queue.cc:1048] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:49.540169 14089 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20260201 08:57:49.540948 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:49.548062 14299 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2686011f0c67477890ba751b5bdee121"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:47576
I20260201 08:57:49.548671 14299 raft_consensus.cc:606] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Received request to transfer leadership to TS 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:49.550827 14299 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:47576
I20260201 08:57:49.551226 14299 raft_consensus.cc:606] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Received request to transfer leadership to TS 201de2dd2b434ccaa229daddfe43640e
I20260201 08:57:49.553205 14299 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:47576
I20260201 08:57:49.553594 14299 raft_consensus.cc:606] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Received request to transfer leadership to TS 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:49.555415 14299 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:47576
I20260201 08:57:49.555778 14299 raft_consensus.cc:606] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Received request to transfer leadership to TS 42aa5ab3fc4949cb91a209b3125b8423
I20260201 08:57:49.557607 14299 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
mode: GRACEFUL
new_leader_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:47576
I20260201 08:57:49.558005 14299 raft_consensus.cc:606] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 LEADER]: Received request to transfer leadership to TS 201de2dd2b434ccaa229daddfe43640e
I20260201 08:57:49.558844 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260201 08:57:49.559247 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:49.848181 14591 raft_consensus.cc:993] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:49.848719 14603 raft_consensus.cc:1081] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 LEADER]: Signalling peer 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:49.850212 14373 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:48370
I20260201 08:57:49.850677 14373 raft_consensus.cc:493] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:49.850962 14373 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:57:49.855645 14373 raft_consensus.cc:515] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.857589 14373 leader_election.cc:290] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 5 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:49.858548 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:49.858661 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7bd3b5590d04bb688495325a9a90b1d" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:49.859122 14222 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:57:49.859196 14299 raft_consensus.cc:3055] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:57:49.859524 14299 raft_consensus.cc:740] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:49.860147 14299 consensus_queue.cc:260] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.861148 14299 raft_consensus.cc:3060] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:57:49.863705 14222 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 5.
I20260201 08:57:49.864769 14336 leader_election.cc:304] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:49.865568 14599 raft_consensus.cc:2804] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:57:49.866187 14299 raft_consensus.cc:2468] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 5.
I20260201 08:57:49.866451 14599 raft_consensus.cc:697] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 5 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:49.867441 14599 consensus_queue.cc:237] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.871464 14591 raft_consensus.cc:993] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:49.871917 14603 raft_consensus.cc:1081] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Signalling peer 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:49.873251 14222 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2686011f0c67477890ba751b5bdee121"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:39314
I20260201 08:57:49.873639 14222 raft_consensus.cc:493] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:49.873932 14222 raft_consensus.cc:3060] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:49.874703 14119 catalog_manager.cc:5654] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 4 to 5, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 5 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:49.878108 14222 raft_consensus.cc:515] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.879957 14222 leader_election.cc:290] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:49.881438 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2686011f0c67477890ba751b5bdee121" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:49.881870 14373 raft_consensus.cc:3060] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:49.883576 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2686011f0c67477890ba751b5bdee121" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:49.884035 14299 raft_consensus.cc:3055] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:57:49.884372 14299 raft_consensus.cc:740] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:49.885289 14299 consensus_queue.cc:260] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.886672 14299 raft_consensus.cc:3060] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:57:49.887450 14373 raft_consensus.cc:2468] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:49.888706 14190 leader_election.cc:304] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:49.890336 14610 raft_consensus.cc:2804] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:57:49.891475 14610 raft_consensus.cc:697] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Becoming Leader. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:49.892441 14610 consensus_queue.cc:237] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.893352 14299 raft_consensus.cc:2468] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 2.
I20260201 08:57:49.900127 14119 catalog_manager.cc:5654] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 reported cstate change: term changed from 1 to 2, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:49.938966 14591 raft_consensus.cc:993] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:49.939419 14603 raft_consensus.cc:1081] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Signalling peer 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:49.940765 14222 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:39314
I20260201 08:57:49.941212 14222 raft_consensus.cc:493] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:49.941474 14222 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:49.945528 14222 raft_consensus.cc:515] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.946883 14222 leader_election.cc:290] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 4 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:49.947635 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:49.947844 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bc6b96debfa423c8bcf2b1d62675e3d" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:49.948167 14299 raft_consensus.cc:3055] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:57:49.948349 14373 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:49.948489 14299 raft_consensus.cc:740] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:49.949247 14299 consensus_queue.cc:260] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.950119 14299 raft_consensus.cc:3060] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:49.952407 14373 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 4.
I20260201 08:57:49.953263 14190 leader_election.cc:304] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:49.953848 14610 raft_consensus.cc:2804] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:57:49.954303 14610 raft_consensus.cc:697] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 LEADER]: Becoming Leader. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:49.954859 14299 raft_consensus.cc:2468] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 4.
I20260201 08:57:49.955104 14610 consensus_queue.cc:237] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:49.961643 14119 catalog_manager.cc:5654] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 reported cstate change: term changed from 3 to 4, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65). New cstate: current_term: 4 leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:50.038242 14603 raft_consensus.cc:993] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:50.038671 14591 raft_consensus.cc:1081] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Signalling peer 201de2dd2b434ccaa229daddfe43640e to start an election
I20260201 08:57:50.039945 14373 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64"
dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
from {username='slave'} at 127.0.0.1:48370
I20260201 08:57:50.040350 14373 raft_consensus.cc:493] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:50.040596 14373 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:50.044495 14373 raft_consensus.cc:515] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:50.045845 14373 leader_election.cc:290] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 3 election: Requested vote from peers 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853), 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399)
I20260201 08:57:50.046700 14222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
I20260201 08:57:50.046777 14299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27f36f86edf44f5b8905d533ea4dee64" candidate_uuid: "201de2dd2b434ccaa229daddfe43640e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:50.047175 14222 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:50.047254 14299 raft_consensus.cc:3055] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:57:50.047582 14299 raft_consensus.cc:740] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:50.048115 14299 consensus_queue.cc:260] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:50.049037 14299 raft_consensus.cc:3060] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:57:50.051301 14222 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 3.
I20260201 08:57:50.052179 14336 leader_election.cc:304] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:50.052980 14599 raft_consensus.cc:2804] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:57:50.053462 14599 raft_consensus.cc:697] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Becoming Leader. State: Replica: 201de2dd2b434ccaa229daddfe43640e, State: Running, Role: LEADER
I20260201 08:57:50.053619 14299 raft_consensus.cc:2468] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 201de2dd2b434ccaa229daddfe43640e in term 3.
I20260201 08:57:50.054332 14599 consensus_queue.cc:237] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:50.060614 14119 catalog_manager.cc:5654] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e reported cstate change: term changed from 2 to 3, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 201de2dd2b434ccaa229daddfe43640e (127.13.194.67). New cstate: current_term: 3 leader_uuid: "201de2dd2b434ccaa229daddfe43640e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: HEALTHY } } }
I20260201 08:57:50.096764 14603 raft_consensus.cc:993] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f: : Instructing follower 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:50.097230 14591 raft_consensus.cc:1081] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Signalling peer 42aa5ab3fc4949cb91a209b3125b8423 to start an election
I20260201 08:57:50.098418 14222 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f"
dest_uuid: "42aa5ab3fc4949cb91a209b3125b8423"
from {username='slave'} at 127.0.0.1:39314
I20260201 08:57:50.098824 14222 raft_consensus.cc:493] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:57:50.099084 14222 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:50.103296 14222 raft_consensus.cc:515] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:50.104959 14222 leader_election.cc:290] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 4 election: Requested vote from peers 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66:46399), 201de2dd2b434ccaa229daddfe43640e (127.13.194.67:45595)
I20260201 08:57:50.106076 14298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "414512e4b48344429ac2e37bb4d97d1f"
I20260201 08:57:50.106611 14298 raft_consensus.cc:3055] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:57:50.106704 14373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a1db9293fbb4fcea06c7d17a760433f" candidate_uuid: "42aa5ab3fc4949cb91a209b3125b8423" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "201de2dd2b434ccaa229daddfe43640e"
I20260201 08:57:50.106856 14298 raft_consensus.cc:740] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 414512e4b48344429ac2e37bb4d97d1f, State: Running, Role: LEADER
I20260201 08:57:50.107182 14373 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:50.107532 14298 consensus_queue.cc:260] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:50.108359 14298 raft_consensus.cc:3060] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:57:50.111229 14373 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 4.
I20260201 08:57:50.112092 14190 leader_election.cc:304] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 201de2dd2b434ccaa229daddfe43640e, 42aa5ab3fc4949cb91a209b3125b8423; no voters:
I20260201 08:57:50.112684 14610 raft_consensus.cc:2804] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:57:50.112695 14298 raft_consensus.cc:2468] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42aa5ab3fc4949cb91a209b3125b8423 in term 4.
I20260201 08:57:50.113284 14610 raft_consensus.cc:697] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 LEADER]: Becoming Leader. State: Replica: 42aa5ab3fc4949cb91a209b3125b8423, State: Running, Role: LEADER
I20260201 08:57:50.114105 14610 consensus_queue.cc:237] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } }
I20260201 08:57:50.120769 14119 catalog_manager.cc:5654] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 reported cstate change: term changed from 3 to 4, leader changed from 414512e4b48344429ac2e37bb4d97d1f (127.13.194.66) to 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65). New cstate: current_term: 4 leader_uuid: "42aa5ab3fc4949cb91a209b3125b8423" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 } health_report { overall_health: UNKNOWN } } }
I20260201 08:57:50.275063 14298 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 5 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260201 08:57:50.276145 14599 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:57:50.285054 14222 raft_consensus.cc:1275] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 5 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260201 08:57:50.286598 14604 consensus_queue.cc:1048] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:57:50.333978 14298 raft_consensus.cc:1275] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:57:50.335282 14610 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:57:50.343698 14373 raft_consensus.cc:1275] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:57:50.345461 14622 consensus_queue.cc:1048] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:57:50.428602 14373 raft_consensus.cc:1275] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:50.429847 14623 consensus_queue.cc:1048] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:57:50.438233 14298 raft_consensus.cc:1275] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:57:50.439785 14611 consensus_queue.cc:1048] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:57:50.535156 14298 raft_consensus.cc:1275] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:50.536201 14604 consensus_queue.cc:1048] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:50.544004 14222 raft_consensus.cc:1275] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Refusing update from remote peer 201de2dd2b434ccaa229daddfe43640e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:57:50.546039 14628 consensus_queue.cc:1048] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [LEADER]: Connected to new peer: Peer: permanent_uuid: "42aa5ab3fc4949cb91a209b3125b8423" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:57:50.560184 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:50.564772 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:50.565132 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:50.677218 14373 raft_consensus.cc:1275] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:57:50.678272 14611 consensus_queue.cc:1048] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "201de2dd2b434ccaa229daddfe43640e" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 45595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:50.680500 14298 raft_consensus.cc:1275] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Refusing update from remote peer 42aa5ab3fc4949cb91a209b3125b8423: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:57:50.681865 14611 consensus_queue.cc:1048] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414512e4b48344429ac2e37bb4d97d1f" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:57:51.566084 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:51.570899 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:51.571288 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:52.572191 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:52.576913 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:52.577315 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:53.578297 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:53.583305 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:53.583638 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:54.584553 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:54.589252 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:54.589608 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:55.590476 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:55.595259 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:55.595675 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:56.596683 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:56.601485 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:56.601903 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:57.602844 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:57.608217 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:57.608608 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:58.609911 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:57:58.615612 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:57:58.616004 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:57:59.642354 14089 auto_leader_rebalancer-test.cc:318] The leader distribution is
I20260201 08:57:59.642884 14089 tablet_server.cc:178] TabletServer@127.13.194.65:0 shutting down...
I20260201 08:57:59.667135 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:57:59.667867 14089 tablet_replica.cc:333] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.668694 14089 raft_consensus.cc:2243] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.669299 14089 raft_consensus.cc:2272] T e5a1230fe64d426190770e7c042ef14b P 42aa5ab3fc4949cb91a209b3125b8423 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.671545 14089 tablet_replica.cc:333] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.672052 14089 raft_consensus.cc:2243] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.672801 14089 raft_consensus.cc:2272] T 2bc6b96debfa423c8bcf2b1d62675e3d P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.674640 14089 tablet_replica.cc:333] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.675148 14089 raft_consensus.cc:2243] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.675884 14089 raft_consensus.cc:2272] T 7a1db9293fbb4fcea06c7d17a760433f P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.677568 14089 tablet_replica.cc:333] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.678061 14089 raft_consensus.cc:2243] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.678439 14089 raft_consensus.cc:2272] T 243a67c6236549f8902be36013b07bd1 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.680672 14089 tablet_replica.cc:333] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.681340 14089 raft_consensus.cc:2243] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.681916 14089 raft_consensus.cc:2272] T c9215e87872649fd804b48cbf1e2485f P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.683454 14089 tablet_replica.cc:333] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.683876 14089 raft_consensus.cc:2243] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.684514 14089 raft_consensus.cc:2272] T 2686011f0c67477890ba751b5bdee121 P 42aa5ab3fc4949cb91a209b3125b8423 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.686002 14089 tablet_replica.cc:333] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.686395 14089 raft_consensus.cc:2243] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.686748 14089 raft_consensus.cc:2272] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 42aa5ab3fc4949cb91a209b3125b8423 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.688217 14089 tablet_replica.cc:333] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.688622 14089 raft_consensus.cc:2243] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.689046 14089 raft_consensus.cc:2272] T f7bd3b5590d04bb688495325a9a90b1d P 42aa5ab3fc4949cb91a209b3125b8423 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.690461 14089 tablet_replica.cc:333] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423: stopping tablet replica
I20260201 08:57:59.690837 14089 raft_consensus.cc:2243] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.691174 14089 raft_consensus.cc:2272] T 27f36f86edf44f5b8905d533ea4dee64 P 42aa5ab3fc4949cb91a209b3125b8423 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260201 08:57:59.766543 14262 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41853: connect: Connection refused (error 111)
I20260201 08:57:59.770535 14089 tablet_server.cc:195] TabletServer@127.13.194.65:0 shutdown complete.
W20260201 08:57:59.770478 14262 consensus_peers.cc:597] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f -> Peer 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853): Couldn't send request to peer 42aa5ab3fc4949cb91a209b3125b8423. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:57:59.783281 14262 consensus_peers.cc:597] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f -> Peer 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853): Couldn't send request to peer 42aa5ab3fc4949cb91a209b3125b8423. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:57:59.791430 14089 tablet_server.cc:178] TabletServer@127.13.194.66:0 shutting down...
I20260201 08:57:59.816155 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:57:59.816848 14089 tablet_replica.cc:333] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.817466 14089 raft_consensus.cc:2243] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.817941 14089 raft_consensus.cc:2272] T 2bc6b96debfa423c8bcf2b1d62675e3d P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.819664 14089 tablet_replica.cc:333] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.820125 14089 raft_consensus.cc:2243] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.820549 14089 raft_consensus.cc:2272] T f7bd3b5590d04bb688495325a9a90b1d P 414512e4b48344429ac2e37bb4d97d1f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.822188 14089 tablet_replica.cc:333] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.822682 14089 raft_consensus.cc:2243] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.823087 14089 raft_consensus.cc:2272] T 27f36f86edf44f5b8905d533ea4dee64 P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.824643 14089 tablet_replica.cc:333] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.825124 14089 raft_consensus.cc:2243] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.825505 14089 raft_consensus.cc:2272] T 2686011f0c67477890ba751b5bdee121 P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.827075 14089 tablet_replica.cc:333] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.827531 14089 raft_consensus.cc:2243] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.828265 14089 raft_consensus.cc:2272] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.829875 14089 tablet_replica.cc:333] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.830343 14089 raft_consensus.cc:2243] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.830757 14089 raft_consensus.cc:2272] T c9215e87872649fd804b48cbf1e2485f P 414512e4b48344429ac2e37bb4d97d1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.832197 14089 tablet_replica.cc:333] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.832643 14089 raft_consensus.cc:2243] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.833410 14089 raft_consensus.cc:2272] T 243a67c6236549f8902be36013b07bd1 P 414512e4b48344429ac2e37bb4d97d1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.835103 14089 tablet_replica.cc:333] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.835536 14089 raft_consensus.cc:2243] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.835906 14089 raft_consensus.cc:2272] T 7a1db9293fbb4fcea06c7d17a760433f P 414512e4b48344429ac2e37bb4d97d1f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.837471 14089 tablet_replica.cc:333] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f: stopping tablet replica
I20260201 08:57:59.837874 14089 raft_consensus.cc:2243] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.838590 14089 raft_consensus.cc:2272] T e5a1230fe64d426190770e7c042ef14b P 414512e4b48344429ac2e37bb4d97d1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:57:59.856292 14336 consensus_peers.cc:597] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e -> Peer 42aa5ab3fc4949cb91a209b3125b8423 (127.13.194.65:41853): Couldn't send request to peer 42aa5ab3fc4949cb91a209b3125b8423. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:57:59.865239 14089 tablet_server.cc:195] TabletServer@127.13.194.66:0 shutdown complete.
I20260201 08:57:59.881969 14089 tablet_server.cc:178] TabletServer@127.13.194.67:0 shutting down...
I20260201 08:57:59.906821 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:57:59.907538 14089 tablet_replica.cc:333] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.908277 14089 raft_consensus.cc:2243] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.908924 14089 raft_consensus.cc:2272] T 2bc6b96debfa423c8bcf2b1d62675e3d P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.910667 14089 tablet_replica.cc:333] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.911130 14089 raft_consensus.cc:2243] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.911949 14089 raft_consensus.cc:2272] T c9215e87872649fd804b48cbf1e2485f P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.913689 14089 tablet_replica.cc:333] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.914201 14089 raft_consensus.cc:2243] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.914590 14089 raft_consensus.cc:2272] T 2686011f0c67477890ba751b5bdee121 P 201de2dd2b434ccaa229daddfe43640e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.916106 14089 tablet_replica.cc:333] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.916544 14089 raft_consensus.cc:2243] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.916989 14089 raft_consensus.cc:2272] T dfd3b87e0ebd4ad289fbafcd4319f5fd P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.918545 14089 tablet_replica.cc:333] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.918998 14089 raft_consensus.cc:2243] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.919708 14089 raft_consensus.cc:2272] T 27f36f86edf44f5b8905d533ea4dee64 P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.921219 14089 tablet_replica.cc:333] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.921664 14089 raft_consensus.cc:2243] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 5 LEADER]: Raft consensus shutting down.
I20260201 08:57:59.922371 14089 raft_consensus.cc:2272] T f7bd3b5590d04bb688495325a9a90b1d P 201de2dd2b434ccaa229daddfe43640e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.923908 14089 tablet_replica.cc:333] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.924332 14089 raft_consensus.cc:2243] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.924686 14089 raft_consensus.cc:2272] T 7a1db9293fbb4fcea06c7d17a760433f P 201de2dd2b434ccaa229daddfe43640e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.926152 14089 tablet_replica.cc:333] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.926622 14089 raft_consensus.cc:2243] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.927042 14089 raft_consensus.cc:2272] T 243a67c6236549f8902be36013b07bd1 P 201de2dd2b434ccaa229daddfe43640e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.928547 14089 tablet_replica.cc:333] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e: stopping tablet replica
I20260201 08:57:59.928997 14089 raft_consensus.cc:2243] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:57:59.929425 14089 raft_consensus.cc:2272] T e5a1230fe64d426190770e7c042ef14b P 201de2dd2b434ccaa229daddfe43640e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:57:59.954481 14089 tablet_server.cc:195] TabletServer@127.13.194.67:0 shutdown complete.
I20260201 08:57:59.970611 14089 master.cc:561] Master@127.13.194.126:34009 shutting down...
I20260201 08:58:00.164206 14089 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:58:00.164767 14089 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:00.165148 14089 tablet_replica.cc:333] T 00000000000000000000000000000000 P b276489a2ad345e381884f5f02acee5d: stopping tablet replica
I20260201 08:58:00.183141 14089 master.cc:583] Master@127.13.194.126:34009 shutdown complete.
201de2dd2b434ccaa229daddfe43640e 1
414512e4b48344429ac2e37bb4d97d1f 4
42aa5ab3fc4949cb91a209b3125b8423 4
201de2dd2b434ccaa229daddfe43640e 3
414512e4b48344429ac2e37bb4d97d1f 3
42aa5ab3fc4949cb91a209b3125b8423 3
201de2dd2b434ccaa229daddfe43640e 1
414512e4b48344429ac2e37bb4d97d1f 8
42aa5ab3fc4949cb91a209b3125b8423 0
201de2dd2b434ccaa229daddfe43640e 3
414512e4b48344429ac2e37bb4d97d1f 3
42aa5ab3fc4949cb91a209b3125b8423 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (31878 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260201 08:58:00.218402 14089 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.194.126:38295
I20260201 08:58:00.219472 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:00.225157 14647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:00.225724 14646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:00.226974 14649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:00.227361 14089 server_base.cc:1060] running on GCE node
I20260201 08:58:00.228145 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:00.228320 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:00.228438 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936280228422 us; error 0 us; skew 500 ppm
I20260201 08:58:00.228926 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:00.231228 14089 webserver.cc:492] Webserver started at http://127.13.194.126:41269/ using document root <none> and password file <none>
I20260201 08:58:00.231663 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:00.231840 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:00.232048 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:00.233165 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/master-0-root/instance:
uuid: "ae7087d1391744a29e892122af325973"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.237382 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260201 08:58:00.240597 14654 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.241360 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 08:58:00.241650 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/master-0-root
uuid: "ae7087d1391744a29e892122af325973"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.241905 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:00.257860 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:00.259024 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:00.294199 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.126:38295
I20260201 08:58:00.294282 14705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.126:38295 every 8 connection(s)
I20260201 08:58:00.297969 14706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.307065 14706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973: Bootstrap starting.
I20260201 08:58:00.311453 14706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:00.315439 14706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973: No bootstrap required, opened a new log
I20260201 08:58:00.317483 14706 raft_consensus.cc:359] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7087d1391744a29e892122af325973" member_type: VOTER }
I20260201 08:58:00.317907 14706 raft_consensus.cc:385] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:00.318136 14706 raft_consensus.cc:740] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae7087d1391744a29e892122af325973, State: Initialized, Role: FOLLOWER
I20260201 08:58:00.318643 14706 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7087d1391744a29e892122af325973" member_type: VOTER }
I20260201 08:58:00.319061 14706 raft_consensus.cc:399] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:58:00.319271 14706 raft_consensus.cc:493] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:58:00.319543 14706 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:00.323395 14706 raft_consensus.cc:515] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7087d1391744a29e892122af325973" member_type: VOTER }
I20260201 08:58:00.324028 14706 leader_election.cc:304] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae7087d1391744a29e892122af325973; no voters:
I20260201 08:58:00.325160 14706 leader_election.cc:290] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:58:00.325507 14709 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:00.326748 14709 raft_consensus.cc:697] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 1 LEADER]: Becoming Leader. State: Replica: ae7087d1391744a29e892122af325973, State: Running, Role: LEADER
I20260201 08:58:00.327337 14709 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7087d1391744a29e892122af325973" member_type: VOTER }
I20260201 08:58:00.327970 14706 sys_catalog.cc:565] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:58:00.332372 14711 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae7087d1391744a29e892122af325973. Latest consensus state: current_term: 1 leader_uuid: "ae7087d1391744a29e892122af325973" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7087d1391744a29e892122af325973" member_type: VOTER } }
I20260201 08:58:00.333022 14711 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [sys.catalog]: This master's current role is: LEADER
I20260201 08:58:00.333271 14710 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae7087d1391744a29e892122af325973" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae7087d1391744a29e892122af325973" member_type: VOTER } }
I20260201 08:58:00.333709 14710 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [sys.catalog]: This master's current role is: LEADER
I20260201 08:58:00.335208 14716 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:58:00.340646 14716 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:58:00.343379 14089 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:58:00.349231 14716 catalog_manager.cc:1357] Generated new cluster ID: 5634157a8c2444ca932d5cf8da7cd361
I20260201 08:58:00.349483 14716 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:58:00.381129 14716 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:58:00.382320 14716 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:58:00.396956 14716 catalog_manager.cc:6027] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973: Generated new TSK 0
I20260201 08:58:00.397519 14716 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:58:00.410205 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:00.415789 14727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:00.416733 14728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:00.418047 14730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:00.418267 14089 server_base.cc:1060] running on GCE node
I20260201 08:58:00.419160 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:00.419350 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:00.419519 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936280419500 us; error 0 us; skew 500 ppm
I20260201 08:58:00.420007 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:00.422269 14089 webserver.cc:492] Webserver started at http://127.13.194.65:33397/ using document root <none> and password file <none>
I20260201 08:58:00.422737 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:00.422900 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:00.423154 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:00.424147 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-0-root/instance:
uuid: "9d02cc37a80544249ab6060617f30a8d"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.428582 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260201 08:58:00.432050 14735 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.432821 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 08:58:00.433156 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-0-root
uuid: "9d02cc37a80544249ab6060617f30a8d"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.433414 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:00.449034 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:00.450239 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:00.451702 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:58:00.454034 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:58:00.454232 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.454483 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:58:00.454622 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.491550 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.65:42637
I20260201 08:58:00.491650 14797 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.65:42637 every 8 connection(s)
I20260201 08:58:00.496325 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:00.503293 14802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:00.505656 14803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:00.508358 14089 server_base.cc:1060] running on GCE node
W20260201 08:58:00.509166 14805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:00.510113 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:00.510358 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:00.510433 14798 heartbeater.cc:344] Connected to a master server at 127.13.194.126:38295
I20260201 08:58:00.510532 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936280510518 us; error 0 us; skew 500 ppm
I20260201 08:58:00.510883 14798 heartbeater.cc:461] Registering TS with master...
I20260201 08:58:00.511117 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:00.511590 14798 heartbeater.cc:507] Master 127.13.194.126:38295 requested a full tablet report, sending...
I20260201 08:58:00.513716 14089 webserver.cc:492] Webserver started at http://127.13.194.66:42179/ using document root <none> and password file <none>
I20260201 08:58:00.513911 14671 ts_manager.cc:194] Registered new tserver with Master: 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637)
I20260201 08:58:00.514232 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:00.514462 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:00.514721 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:00.515723 14671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56354
I20260201 08:58:00.515776 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-1-root/instance:
uuid: "baa9855381ce480a8590db2271c1b470"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.520478 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260201 08:58:00.523651 14810 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.524392 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260201 08:58:00.524643 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-1-root
uuid: "baa9855381ce480a8590db2271c1b470"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.524919 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:00.556200 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:00.557422 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:00.558808 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:58:00.560976 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:58:00.561154 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.561380 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:58:00.561518 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.599228 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.66:42349
I20260201 08:58:00.599314 14872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.66:42349 every 8 connection(s)
I20260201 08:58:00.603775 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:00.609987 14876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:00.610500 14877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:00.613364 14879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:00.613564 14089 server_base.cc:1060] running on GCE node
I20260201 08:58:00.614318 14873 heartbeater.cc:344] Connected to a master server at 127.13.194.126:38295
I20260201 08:58:00.614481 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260201 08:58:00.614653 14873 heartbeater.cc:461] Registering TS with master...
W20260201 08:58:00.614727 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:00.615005 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936280614989 us; error 0 us; skew 500 ppm
I20260201 08:58:00.615461 14873 heartbeater.cc:507] Master 127.13.194.126:38295 requested a full tablet report, sending...
I20260201 08:58:00.615518 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:00.617568 14671 ts_manager.cc:194] Registered new tserver with Master: baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:00.618288 14089 webserver.cc:492] Webserver started at http://127.13.194.67:35881/ using document root <none> and password file <none>
I20260201 08:58:00.618932 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:00.619153 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:00.619320 14671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56356
I20260201 08:58:00.619448 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:00.620944 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-2-root/instance:
uuid: "ae718f3470d54aaca7f5fb973000014f"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.625207 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260201 08:58:00.628264 14884 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.628978 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 08:58:00.629256 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-2-root
uuid: "ae718f3470d54aaca7f5fb973000014f"
format_stamp: "Formatted at 2026-02-01 08:58:00 on dist-test-slave-7fnp"
I20260201 08:58:00.629498 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1769936248176475-14089-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:00.662225 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:00.663551 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:00.665012 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:58:00.667131 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:58:00.667330 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.667546 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:58:00.667699 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:00.704629 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.67:36941
I20260201 08:58:00.704749 14946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.67:36941 every 8 connection(s)
I20260201 08:58:00.717850 14947 heartbeater.cc:344] Connected to a master server at 127.13.194.126:38295
I20260201 08:58:00.718216 14947 heartbeater.cc:461] Registering TS with master...
I20260201 08:58:00.718956 14947 heartbeater.cc:507] Master 127.13.194.126:38295 requested a full tablet report, sending...
I20260201 08:58:00.720749 14671 ts_manager.cc:194] Registered new tserver with Master: ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:00.721145 14089 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01332728s
I20260201 08:58:00.722090 14671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48864
I20260201 08:58:00.745756 14671 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48872:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 08:58:00.748476 14671 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 08:58:00.834084 14763 tablet_service.cc:1505] Processing CreateTablet for tablet 33cfe8c6817e4cc7a2bc0f6ab7504d60 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260201 08:58:00.835490 14763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cfe8c6817e4cc7a2bc0f6ab7504d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.835749 14837 tablet_service.cc:1505] Processing CreateTablet for tablet f1265b5459a54ca6ba94cd958f4c60b5 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260201 08:58:00.837101 14837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1265b5459a54ca6ba94cd958f4c60b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.837934 14762 tablet_service.cc:1505] Processing CreateTablet for tablet f1265b5459a54ca6ba94cd958f4c60b5 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260201 08:58:00.838424 14833 tablet_service.cc:1505] Processing CreateTablet for tablet 32153f11aaef4157912baebcca102ccc (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260201 08:58:00.839215 14762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1265b5459a54ca6ba94cd958f4c60b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.839653 14833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32153f11aaef4157912baebcca102ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.842013 14836 tablet_service.cc:1505] Processing CreateTablet for tablet d82268dbf5484caba89dc55f3761892c (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260201 08:58:00.842463 14831 tablet_service.cc:1505] Processing CreateTablet for tablet 4d38bfe89dbb4f92bb4d288968629f9f (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260201 08:58:00.843341 14836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82268dbf5484caba89dc55f3761892c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.844278 14757 tablet_service.cc:1505] Processing CreateTablet for tablet 39cb022e9f0a4f7689de3c5b3fa03eae (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260201 08:58:00.844547 14838 tablet_service.cc:1505] Processing CreateTablet for tablet 33cfe8c6817e4cc7a2bc0f6ab7504d60 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260201 08:58:00.845605 14757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cb022e9f0a4f7689de3c5b3fa03eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.845777 14838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cfe8c6817e4cc7a2bc0f6ab7504d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.846076 14835 tablet_service.cc:1505] Processing CreateTablet for tablet 3c73128561a046e6adcbc3ed387310e4 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260201 08:58:00.847280 14835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c73128561a046e6adcbc3ed387310e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.850028 14832 tablet_service.cc:1505] Processing CreateTablet for tablet 39cb022e9f0a4f7689de3c5b3fa03eae (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260201 08:58:00.850018 14834 tablet_service.cc:1505] Processing CreateTablet for tablet b0db090127504a04ad96b6f631941983 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260201 08:58:00.851315 14832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cb022e9f0a4f7689de3c5b3fa03eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.851960 14834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0db090127504a04ad96b6f631941983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.852535 14761 tablet_service.cc:1505] Processing CreateTablet for tablet d82268dbf5484caba89dc55f3761892c (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260201 08:58:00.853899 14761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82268dbf5484caba89dc55f3761892c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.854270 14830 tablet_service.cc:1505] Processing CreateTablet for tablet 892bd3aede9b45098921d309c961a816 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260201 08:58:00.852990 14831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d38bfe89dbb4f92bb4d288968629f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.855949 14756 tablet_service.cc:1505] Processing CreateTablet for tablet 4d38bfe89dbb4f92bb4d288968629f9f (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260201 08:58:00.856397 14830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892bd3aede9b45098921d309c961a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.858397 14760 tablet_service.cc:1505] Processing CreateTablet for tablet 3c73128561a046e6adcbc3ed387310e4 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260201 08:58:00.860560 14755 tablet_service.cc:1505] Processing CreateTablet for tablet 892bd3aede9b45098921d309c961a816 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260201 08:58:00.863056 14754 tablet_service.cc:1505] Processing CreateTablet for tablet 5a9feb07deb0485ca0233f18808edf06 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260201 08:58:00.851250 14759 tablet_service.cc:1505] Processing CreateTablet for tablet b0db090127504a04ad96b6f631941983 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260201 08:58:00.865350 14829 tablet_service.cc:1505] Processing CreateTablet for tablet 5a9feb07deb0485ca0233f18808edf06 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260201 08:58:00.866098 14759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0db090127504a04ad96b6f631941983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.866490 14829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9feb07deb0485ca0233f18808edf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.850063 14758 tablet_service.cc:1505] Processing CreateTablet for tablet 32153f11aaef4157912baebcca102ccc (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260201 08:58:00.868790 14758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32153f11aaef4157912baebcca102ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.873481 14754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9feb07deb0485ca0233f18808edf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.877277 14756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d38bfe89dbb4f92bb4d288968629f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.883399 14760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c73128561a046e6adcbc3ed387310e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.897162 14755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892bd3aede9b45098921d309c961a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.899514 14912 tablet_service.cc:1505] Processing CreateTablet for tablet 33cfe8c6817e4cc7a2bc0f6ab7504d60 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260201 08:58:00.901986 14912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33cfe8c6817e4cc7a2bc0f6ab7504d60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.908636 14911 tablet_service.cc:1505] Processing CreateTablet for tablet f1265b5459a54ca6ba94cd958f4c60b5 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260201 08:58:00.910000 14911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1265b5459a54ca6ba94cd958f4c60b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.914106 14910 tablet_service.cc:1505] Processing CreateTablet for tablet d82268dbf5484caba89dc55f3761892c (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260201 08:58:00.915480 14910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82268dbf5484caba89dc55f3761892c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.917197 14904 tablet_service.cc:1505] Processing CreateTablet for tablet 892bd3aede9b45098921d309c961a816 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260201 08:58:00.918077 14909 tablet_service.cc:1505] Processing CreateTablet for tablet 3c73128561a046e6adcbc3ed387310e4 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260201 08:58:00.918506 14904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 892bd3aede9b45098921d309c961a816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.919313 14909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c73128561a046e6adcbc3ed387310e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.921991 14908 tablet_service.cc:1505] Processing CreateTablet for tablet b0db090127504a04ad96b6f631941983 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260201 08:58:00.923233 14908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0db090127504a04ad96b6f631941983. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.926030 14907 tablet_service.cc:1505] Processing CreateTablet for tablet 32153f11aaef4157912baebcca102ccc (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260201 08:58:00.926501 14903 tablet_service.cc:1505] Processing CreateTablet for tablet 5a9feb07deb0485ca0233f18808edf06 (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260201 08:58:00.927284 14907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32153f11aaef4157912baebcca102ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.930738 14963 tablet_bootstrap.cc:492] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:00.931864 14903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a9feb07deb0485ca0233f18808edf06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.933724 14905 tablet_service.cc:1505] Processing CreateTablet for tablet 4d38bfe89dbb4f92bb4d288968629f9f (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260201 08:58:00.935073 14905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d38bfe89dbb4f92bb4d288968629f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.938309 14906 tablet_service.cc:1505] Processing CreateTablet for tablet 39cb022e9f0a4f7689de3c5b3fa03eae (DEFAULT_TABLE table=test-workload [id=4001fbf2ae674c9897e4b276c08baf2c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260201 08:58:00.939627 14906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cb022e9f0a4f7689de3c5b3fa03eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:00.996793 14963 tablet_bootstrap.cc:654] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.030946 14963 tablet_bootstrap.cc:492] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.031405 14963 ts_tablet_manager.cc:1403] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.101s user 0.019s sys 0.000s
I20260201 08:58:01.033160 14962 tablet_bootstrap.cc:492] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.033802 14963 raft_consensus.cc:359] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.034468 14963 raft_consensus.cc:385] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.034776 14963 raft_consensus.cc:740] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.035156 14964 tablet_bootstrap.cc:492] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.035445 14963 consensus_queue.cc:260] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.038347 14798 heartbeater.cc:499] Master 127.13.194.126:38295 was elected leader, sending a full tablet report...
I20260201 08:58:01.038872 14963 ts_tablet_manager.cc:1434] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260201 08:58:01.039783 14963 tablet_bootstrap.cc:492] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.041150 14964 tablet_bootstrap.cc:654] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.043032 14962 tablet_bootstrap.cc:654] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.046023 14963 tablet_bootstrap.cc:654] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.052162 14964 tablet_bootstrap.cc:492] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.052786 14964 ts_tablet_manager.cc:1403] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.009s
I20260201 08:58:01.055378 14963 tablet_bootstrap.cc:492] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.055502 14964 raft_consensus.cc:359] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.055995 14963 ts_tablet_manager.cc:1403] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20260201 08:58:01.056288 14964 raft_consensus.cc:385] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.056654 14964 raft_consensus.cc:740] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.057611 14964 consensus_queue.cc:260] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.058815 14963 raft_consensus.cc:359] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.059612 14963 raft_consensus.cc:385] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.059942 14963 raft_consensus.cc:740] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.060904 14963 consensus_queue.cc:260] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.065245 14962 tablet_bootstrap.cc:492] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.065770 14962 ts_tablet_manager.cc:1403] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.042s user 0.009s sys 0.012s
I20260201 08:58:01.068176 14964 ts_tablet_manager.cc:1434] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.015s user 0.006s sys 0.006s
I20260201 08:58:01.068663 14947 heartbeater.cc:499] Master 127.13.194.126:38295 was elected leader, sending a full tablet report...
I20260201 08:58:01.068894 14963 ts_tablet_manager.cc:1434] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260201 08:58:01.068578 14962 raft_consensus.cc:359] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.069304 14964 tablet_bootstrap.cc:492] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.069419 14962 raft_consensus.cc:385] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.069846 14962 raft_consensus.cc:740] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.069968 14963 tablet_bootstrap.cc:492] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.070585 14962 consensus_queue.cc:260] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.075765 14964 tablet_bootstrap.cc:654] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.076460 14963 tablet_bootstrap.cc:654] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.087522 14964 tablet_bootstrap.cc:492] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.087702 14963 tablet_bootstrap.cc:492] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.088135 14964 ts_tablet_manager.cc:1403] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.010s
I20260201 08:58:01.088198 14963 ts_tablet_manager.cc:1403] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20260201 08:58:01.091081 14963 raft_consensus.cc:359] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.091244 14964 raft_consensus.cc:359] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.091957 14963 raft_consensus.cc:385] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.092082 14964 raft_consensus.cc:385] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.092330 14963 raft_consensus.cc:740] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.092432 14964 raft_consensus.cc:740] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.093386 14963 consensus_queue.cc:260] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.093349 14964 consensus_queue.cc:260] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.094419 14966 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.094856 14966 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.096138 14964 ts_tablet_manager.cc:1434] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:58:01.097242 14964 tablet_bootstrap.cc:492] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.099627 14966 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.101888 14963 ts_tablet_manager.cc:1434] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.013s user 0.002s sys 0.004s
I20260201 08:58:01.103332 14964 tablet_bootstrap.cc:654] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.103461 14963 tablet_bootstrap.cc:492] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.110335 14963 tablet_bootstrap.cc:654] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.115253 14964 tablet_bootstrap.cc:492] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.115862 14964 ts_tablet_manager.cc:1403] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.007s
I20260201 08:58:01.118961 14964 raft_consensus.cc:359] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.119941 14964 raft_consensus.cc:385] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.120316 14964 raft_consensus.cc:740] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.121320 14964 consensus_queue.cc:260] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.124030 14964 ts_tablet_manager.cc:1434] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260201 08:58:01.125144 14964 tablet_bootstrap.cc:492] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.132459 14963 tablet_bootstrap.cc:492] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.132812 14964 tablet_bootstrap.cc:654] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.133069 14963 ts_tablet_manager.cc:1403] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.030s user 0.013s sys 0.015s
I20260201 08:58:01.135900 14963 raft_consensus.cc:359] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.136893 14963 raft_consensus.cc:385] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.137257 14963 raft_consensus.cc:740] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.138164 14963 consensus_queue.cc:260] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.141672 14963 ts_tablet_manager.cc:1434] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260201 08:58:01.142694 14963 tablet_bootstrap.cc:492] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.146979 14964 tablet_bootstrap.cc:492] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.147347 14873 heartbeater.cc:499] Master 127.13.194.126:38295 was elected leader, sending a full tablet report...
I20260201 08:58:01.147543 14964 ts_tablet_manager.cc:1403] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.007s
I20260201 08:58:01.148059 14962 ts_tablet_manager.cc:1434] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.082s user 0.030s sys 0.049s
I20260201 08:58:01.149137 14962 tablet_bootstrap.cc:492] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.152783 14963 tablet_bootstrap.cc:654] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.155623 14962 tablet_bootstrap.cc:654] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.150377 14964 raft_consensus.cc:359] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.161237 14964 raft_consensus.cc:385] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.161635 14964 raft_consensus.cc:740] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.162516 14964 consensus_queue.cc:260] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.164011 14963 tablet_bootstrap.cc:492] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.164520 14963 ts_tablet_manager.cc:1403] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.004s
I20260201 08:58:01.165179 14964 ts_tablet_manager.cc:1434] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.017s user 0.002s sys 0.004s
I20260201 08:58:01.166203 14964 tablet_bootstrap.cc:492] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.166807 14962 tablet_bootstrap.cc:492] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.167340 14962 ts_tablet_manager.cc:1403] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.010s
I20260201 08:58:01.167281 14963 raft_consensus.cc:359] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.168233 14963 raft_consensus.cc:385] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.168577 14963 raft_consensus.cc:740] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.169443 14963 consensus_queue.cc:260] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.170164 14962 raft_consensus.cc:359] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.170915 14962 raft_consensus.cc:385] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.171240 14962 raft_consensus.cc:740] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.172026 14963 ts_tablet_manager.cc:1434] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:58:01.171933 14962 consensus_queue.cc:260] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.172569 14964 tablet_bootstrap.cc:654] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.174223 14962 ts_tablet_manager.cc:1434] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260201 08:58:01.173099 14963 tablet_bootstrap.cc:492] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.175206 14962 tablet_bootstrap.cc:492] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.173628 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.176899 14848 raft_consensus.cc:2468] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.178766 14737 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.180955 14963 tablet_bootstrap.cc:654] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.181510 14962 tablet_bootstrap.cc:654] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.199743 14966 raft_consensus.cc:2804] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.200215 14966 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.200541 14966 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.208024 14966 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
W20260201 08:58:01.208614 14948 tablet.cc:2378] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 08:58:01.210956 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.211581 14848 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.213496 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
W20260201 08:58:01.215058 14736 leader_election.cc:343] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.216367 14970 raft_consensus.cc:493] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.216821 14970 raft_consensus.cc:515] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.217300 14962 tablet_bootstrap.cc:492] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.217734 14962 ts_tablet_manager.cc:1403] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.043s user 0.017s sys 0.025s
I20260201 08:58:01.218219 14971 raft_consensus.cc:493] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.218745 14848 raft_consensus.cc:2468] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.218633 14971 raft_consensus.cc:515] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.219834 14966 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.220671 14971 leader_election.cc:290] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.220446 14962 raft_consensus.cc:359] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.221215 14962 raft_consensus.cc:385] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.221498 14962 raft_consensus.cc:740] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.221889 14737 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.222294 14962 consensus_queue.cc:260] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.223137 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.223778 14921 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.224195 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.224932 14736 leader_election.cc:304] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:01.223161 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.226346 14971 raft_consensus.cc:2804] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.226462 14962 ts_tablet_manager.cc:1434] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260201 08:58:01.226518 14736 leader_election.cc:343] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.227656 14962 tablet_bootstrap.cc:492] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.227845 14966 raft_consensus.cc:2804] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.228291 14966 raft_consensus.cc:493] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 08:58:01.227674 14737 leader_election.cc:343] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.228610 14966 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.229635 14964 tablet_bootstrap.cc:492] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.230955 14964 ts_tablet_manager.cc:1403] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.031s
I20260201 08:58:01.219224 14970 leader_election.cc:290] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:01.234236 14962 tablet_bootstrap.cc:654] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.235116 14964 raft_consensus.cc:359] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.235785 14964 raft_consensus.cc:385] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.236063 14964 raft_consensus.cc:740] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.236388 14966 raft_consensus.cc:515] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.239668 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.240125 14966 leader_election.cc:290] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.241133 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.241709 14922 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.236692 14964 consensus_queue.cc:260] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.246347 14962 tablet_bootstrap.cc:492] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.246731 14964 ts_tablet_manager.cc:1434] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260201 08:58:01.246901 14962 ts_tablet_manager.cc:1403] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
W20260201 08:58:01.248095 14737 leader_election.cc:343] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.248828 14964 tablet_bootstrap.cc:492] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.250708 14962 raft_consensus.cc:359] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.251426 14962 raft_consensus.cc:385] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.251770 14963 tablet_bootstrap.cc:492] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.251715 14962 raft_consensus.cc:740] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.247756 14971 raft_consensus.cc:697] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.252292 14963 ts_tablet_manager.cc:1403] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.079s user 0.014s sys 0.011s
I20260201 08:58:01.252807 14971 consensus_queue.cc:237] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.255100 14963 raft_consensus.cc:359] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.255645 14964 tablet_bootstrap.cc:654] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.256493 14962 consensus_queue.cc:260] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.257220 14922 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.255774 14963 raft_consensus.cc:385] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.258139 14963 raft_consensus.cc:740] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.258529 14736 leader_election.cc:304] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters: baa9855381ce480a8590db2271c1b470
I20260201 08:58:01.258946 14963 consensus_queue.cc:260] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.260634 14987 raft_consensus.cc:2804] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.261322 14962 ts_tablet_manager.cc:1434] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260201 08:58:01.261204 14963 ts_tablet_manager.cc:1434] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.009s user 0.008s sys 0.001s
I20260201 08:58:01.262307 14962 tablet_bootstrap.cc:492] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.262645 14963 tablet_bootstrap.cc:492] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.269493 14963 tablet_bootstrap.cc:654] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.276017 14962 tablet_bootstrap.cc:654] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.281178 14963 tablet_bootstrap.cc:492] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.281823 14963 ts_tablet_manager.cc:1403] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.004s
I20260201 08:58:01.283085 14987 raft_consensus.cc:697] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.284035 14987 consensus_queue.cc:237] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.284440 14963 raft_consensus.cc:359] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.285240 14963 raft_consensus.cc:385] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.285588 14963 raft_consensus.cc:740] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.286315 14963 consensus_queue.cc:260] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.288574 14963 ts_tablet_manager.cc:1434] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:01.289556 14963 tablet_bootstrap.cc:492] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.293184 14964 tablet_bootstrap.cc:492] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.293653 14964 ts_tablet_manager.cc:1403] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.010s
I20260201 08:58:01.298300 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.299762 14963 tablet_bootstrap.cc:654] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.300832 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
W20260201 08:58:01.301472 14886 leader_election.cc:343] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:01.302323 14887 leader_election.cc:343] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.302819 14887 leader_election.cc:304] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f; no voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470
I20260201 08:58:01.302940 14962 tablet_bootstrap.cc:492] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.298187 14671 catalog_manager.cc:5654] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 1 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.303439 14962 ts_tablet_manager.cc:1403] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.041s user 0.029s sys 0.002s
I20260201 08:58:01.303472 14970 raft_consensus.cc:2749] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:01.304983 14963 tablet_bootstrap.cc:492] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.304934 14964 raft_consensus.cc:359] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.305809 14964 raft_consensus.cc:385] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.306046 14964 raft_consensus.cc:740] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.306341 14962 raft_consensus.cc:359] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.306608 14964 consensus_queue.cc:260] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.305510 14963 ts_tablet_manager.cc:1403] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.001s
I20260201 08:58:01.307093 14962 raft_consensus.cc:385] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.307487 14962 raft_consensus.cc:740] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.308703 14964 ts_tablet_manager.cc:1434] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.015s user 0.004s sys 0.002s
I20260201 08:58:01.308284 14962 consensus_queue.cc:260] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.309669 14964 tablet_bootstrap.cc:492] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.314349 14962 ts_tablet_manager.cc:1434] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260201 08:58:01.315465 14962 tablet_bootstrap.cc:492] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.312042 14963 raft_consensus.cc:359] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.317049 14963 raft_consensus.cc:385] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.317355 14963 raft_consensus.cc:740] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.317992 14963 consensus_queue.cc:260] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.320228 14963 ts_tablet_manager.cc:1434] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20260201 08:58:01.321013 14970 raft_consensus.cc:493] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.321144 14963 tablet_bootstrap.cc:492] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.325757 14962 tablet_bootstrap.cc:654] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.321487 14970 raft_consensus.cc:515] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.327100 14970 leader_election.cc:290] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:01.327967 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:01.328590 14773 raft_consensus.cc:2468] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 0.
I20260201 08:58:01.329224 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.329855 14847 raft_consensus.cc:2468] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 0.
I20260201 08:58:01.330010 14887 leader_election.cc:304] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:01.330957 14970 raft_consensus.cc:2804] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.331164 14963 tablet_bootstrap.cc:654] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.331362 14970 raft_consensus.cc:493] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.331701 14970 raft_consensus.cc:3060] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.332841 14964 tablet_bootstrap.cc:654] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
W20260201 08:58:01.338583 14719 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:01.340600 14970 raft_consensus.cc:515] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.343729 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:01.344341 14773 raft_consensus.cc:3060] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.351511 14773 raft_consensus.cc:2468] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 1.
I20260201 08:58:01.356308 14887 leader_election.cc:304] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:01.353205 14963 tablet_bootstrap.cc:492] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.359895 14963 ts_tablet_manager.cc:1403] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.039s user 0.014s sys 0.008s
I20260201 08:58:01.358958 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.360821 14847 raft_consensus.cc:3060] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.355086 14964 tablet_bootstrap.cc:492] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.361845 14964 ts_tablet_manager.cc:1403] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.052s user 0.018s sys 0.004s
I20260201 08:58:01.365294 14987 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.365739 14987 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.367612 14987 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.367830 14847 raft_consensus.cc:2468] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 1.
I20260201 08:58:01.369122 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.369702 14848 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.370981 14737 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.371125 14963 raft_consensus.cc:359] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.371733 14963 raft_consensus.cc:385] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.371995 14963 raft_consensus.cc:740] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.372710 14987 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.372594 14963 consensus_queue.cc:260] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.372833 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.373129 14987 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.373548 14987 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.369622 14671 catalog_manager.cc:5654] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 1 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.374958 14963 ts_tablet_manager.cc:1434] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:58:01.373567 14922 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.376773 14963 tablet_bootstrap.cc:492] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d: Bootstrap starting.
I20260201 08:58:01.360275 14970 leader_election.cc:290] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:01.375602 15002 raft_consensus.cc:2804] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.377791 14962 tablet_bootstrap.cc:492] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.378305 14962 ts_tablet_manager.cc:1403] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.063s user 0.031s sys 0.020s
I20260201 08:58:01.378847 15002 raft_consensus.cc:697] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:01.379864 15002 consensus_queue.cc:237] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.382385 14963 tablet_bootstrap.cc:654] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.383358 14987 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.381047 14962 raft_consensus.cc:359] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.384263 14962 raft_consensus.cc:385] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.384582 14962 raft_consensus.cc:740] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.364584 14964 raft_consensus.cc:359] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.385366 14964 raft_consensus.cc:385] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.385669 14964 raft_consensus.cc:740] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.386510 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.386412 14964 consensus_queue.cc:260] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.387039 14848 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.388674 14964 ts_tablet_manager.cc:1434] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.027s user 0.004s sys 0.000s
I20260201 08:58:01.389643 14964 tablet_bootstrap.cc:492] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.390709 14971 raft_consensus.cc:493] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.391155 14971 raft_consensus.cc:515] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.392448 14963 tablet_bootstrap.cc:492] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d: No bootstrap required, opened a new log
I20260201 08:58:01.392902 14963 ts_tablet_manager.cc:1403] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.000s
I20260201 08:58:01.393020 14971 leader_election.cc:290] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.393187 14962 consensus_queue.cc:260] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.394179 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.394731 14922 raft_consensus.cc:2468] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.395520 14962 ts_tablet_manager.cc:1434] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.017s user 0.000s sys 0.004s
I20260201 08:58:01.395252 14963 raft_consensus.cc:359] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.396513 14736 leader_election.cc:304] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:01.397425 14971 raft_consensus.cc:2804] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.399238 14971 raft_consensus.cc:493] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.399582 14971 raft_consensus.cc:3060] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.399757 14962 tablet_bootstrap.cc:492] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.395881 14963 raft_consensus.cc:385] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.400213 14963 raft_consensus.cc:740] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.401002 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
W20260201 08:58:01.402467 14737 leader_election.cc:343] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.404215 14669 catalog_manager.cc:5654] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 0 to 1, leader changed from <none> to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 1 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:01.405063 14848 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.405787 14962 tablet_bootstrap.cc:654] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.406914 14971 raft_consensus.cc:515] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.398867 14964 tablet_bootstrap.cc:654] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.407687 14737 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.408553 14990 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.409019 14990 raft_consensus.cc:697] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.409776 14990 consensus_queue.cc:237] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.410055 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
W20260201 08:58:01.411505 14737 leader_election.cc:343] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.412470 14971 leader_election.cc:290] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.400808 14963 consensus_queue.cc:260] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.410084 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.414829 14922 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.417070 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.417613 14921 raft_consensus.cc:3060] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.407703 14987 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.425541 14921 raft_consensus.cc:2468] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.427727 14987 raft_consensus.cc:493] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.428493 14963 ts_tablet_manager.cc:1434] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260201 08:58:01.428336 14987 raft_consensus.cc:515] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.426781 14736 leader_election.cc:304] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters: baa9855381ce480a8590db2271c1b470
I20260201 08:58:01.430018 14990 raft_consensus.cc:2804] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.430723 14990 raft_consensus.cc:697] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.431710 14990 consensus_queue.cc:237] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.431634 14922 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.434022 14987 leader_election.cc:290] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.433315 14669 catalog_manager.cc:5654] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 1 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.434718 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.435108 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.436218 14848 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
W20260201 08:58:01.436937 14736 leader_election.cc:343] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.437670 14737 leader_election.cc:304] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters: ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:01.439056 14987 raft_consensus.cc:2804] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.439496 14987 raft_consensus.cc:493] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.439888 14987 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.441915 14964 tablet_bootstrap.cc:492] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.442339 14964 ts_tablet_manager.cc:1403] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.053s user 0.012s sys 0.015s
I20260201 08:58:01.444823 14964 raft_consensus.cc:359] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.445510 14964 raft_consensus.cc:385] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.445757 14964 raft_consensus.cc:740] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.446393 14964 consensus_queue.cc:260] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.448397 14964 ts_tablet_manager.cc:1434] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:58:01.449251 14964 tablet_bootstrap.cc:492] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.449276 14987 raft_consensus.cc:515] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.450906 14971 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.451383 14971 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.453349 14971 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.454596 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.455207 14921 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.455766 14987 leader_election.cc:290] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.456491 14736 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:01.456765 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.457213 14964 tablet_bootstrap.cc:654] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.457283 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.457391 14987 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.457914 14987 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 08:58:01.458011 14736 leader_election.cc:343] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:01.456874 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.458488 14987 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.458792 14848 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.457861 14847 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.457998 14962 tablet_bootstrap.cc:492] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.461288 14962 ts_tablet_manager.cc:1403] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.062s user 0.009s sys 0.021s
I20260201 08:58:01.464036 14962 raft_consensus.cc:359] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.464717 14962 raft_consensus.cc:385] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.464620 14987 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.458091 15002 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.465655 15002 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.467602 15002 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:01.465123 14962 raft_consensus.cc:740] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.468325 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:01.468636 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.469432 14848 raft_consensus.cc:2393] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae718f3470d54aaca7f5fb973000014f in current term 1: Already voted for candidate 9d02cc37a80544249ab6060617f30a8d in this term.
I20260201 08:58:01.470436 14886 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f; no voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470
I20260201 08:58:01.470583 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.471117 14848 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.471340 14847 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.471635 14970 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.468642 14962 consensus_queue.cc:260] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.472433 14737 leader_election.cc:304] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters: ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:01.473064 14964 tablet_bootstrap.cc:492] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.473474 14964 ts_tablet_manager.cc:1403] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.000s
I20260201 08:58:01.473519 14971 raft_consensus.cc:2804] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.474040 14971 raft_consensus.cc:697] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.474784 14971 consensus_queue.cc:237] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.475967 14964 raft_consensus.cc:359] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.476570 14964 raft_consensus.cc:385] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.476811 14964 raft_consensus.cc:740] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.477203 15002 raft_consensus.cc:493] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.477463 14964 consensus_queue.cc:260] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.477632 15002 raft_consensus.cc:515] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.478786 14970 raft_consensus.cc:2749] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:01.480265 15002 leader_election.cc:290] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:01.481062 14962 ts_tablet_manager.cc:1434] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.019s user 0.006s sys 0.001s
I20260201 08:58:01.480939 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.483230 14847 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 0.
I20260201 08:58:01.480307 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:01.484264 14886 leader_election.cc:304] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.484818 14773 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 0.
I20260201 08:58:01.486994 14962 tablet_bootstrap.cc:492] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.487051 14987 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.487313 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.487901 14921 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.489063 14848 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.490168 14737 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.490988 14987 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.492106 14987 raft_consensus.cc:697] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.493620 15002 raft_consensus.cc:2804] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.494148 15002 raft_consensus.cc:493] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.494699 15002 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.493718 14987 consensus_queue.cc:237] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.503816 14921 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.503939 14669 catalog_manager.cc:5654] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 1 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.509131 15002 raft_consensus.cc:515] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.498093 14962 tablet_bootstrap.cc:654] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.514668 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:01.515316 14773 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.522166 14962 tablet_bootstrap.cc:492] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.522711 14962 ts_tablet_manager.cc:1403] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.005s
I20260201 08:58:01.523806 14773 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 1.
I20260201 08:58:01.525223 14887 leader_election.cc:304] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:01.525629 14962 raft_consensus.cc:359] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.526198 14970 raft_consensus.cc:2804] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.526571 14962 raft_consensus.cc:385] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.526757 14970 raft_consensus.cc:697] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:01.526887 14962 raft_consensus.cc:740] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.527808 14962 consensus_queue.cc:260] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.527805 14970 consensus_queue.cc:237] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.532800 14962 ts_tablet_manager.cc:1434] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.010s user 0.002s sys 0.004s
I20260201 08:58:01.533816 14962 tablet_bootstrap.cc:492] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.534211 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.534818 14848 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.538244 15002 leader_election.cc:290] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 1 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:01.540176 14669 catalog_manager.cc:5654] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 0 to 1, leader changed from <none> to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 1 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:01.543036 14964 ts_tablet_manager.cc:1434] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.069s user 0.028s sys 0.017s
I20260201 08:58:01.543985 14964 tablet_bootstrap.cc:492] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f: Bootstrap starting.
I20260201 08:58:01.542922 14848 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 1.
I20260201 08:58:01.547976 14962 tablet_bootstrap.cc:654] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.549459 14964 tablet_bootstrap.cc:654] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.552253 14671 catalog_manager.cc:5654] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 1 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.554176 14671 catalog_manager.cc:5654] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 1 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.560000 14964 tablet_bootstrap.cc:492] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f: No bootstrap required, opened a new log
I20260201 08:58:01.561168 14964 ts_tablet_manager.cc:1403] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f: Time spent bootstrapping tablet: real 0.017s user 0.016s sys 0.000s
I20260201 08:58:01.563266 14962 tablet_bootstrap.cc:492] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.563144 14964 raft_consensus.cc:359] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.563692 14962 ts_tablet_manager.cc:1403] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.008s
I20260201 08:58:01.563690 14964 raft_consensus.cc:385] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.564218 14964 raft_consensus.cc:740] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.564735 14964 consensus_queue.cc:260] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.566418 14962 raft_consensus.cc:359] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.566910 14962 raft_consensus.cc:385] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.566988 14964 ts_tablet_manager.cc:1434] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:58:01.567158 14962 raft_consensus.cc:740] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.567715 14962 consensus_queue.cc:260] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.569564 14962 ts_tablet_manager.cc:1434] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 08:58:01.570405 14962 tablet_bootstrap.cc:492] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470: Bootstrap starting.
I20260201 08:58:01.574747 14962 tablet_bootstrap.cc:654] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:01.578926 14972 raft_consensus.cc:493] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.579157 14962 tablet_bootstrap.cc:492] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470: No bootstrap required, opened a new log
I20260201 08:58:01.579535 14962 ts_tablet_manager.cc:1403] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260201 08:58:01.579401 14972 raft_consensus.cc:515] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.581404 14972 leader_election.cc:290] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.581472 14962 raft_consensus.cc:359] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.582293 14962 raft_consensus.cc:385] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:01.582582 14962 raft_consensus.cc:740] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Initialized, Role: FOLLOWER
I20260201 08:58:01.583168 14962 consensus_queue.cc:260] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.585219 14962 ts_tablet_manager.cc:1434] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470: Time spent starting tablet: real 0.005s user 0.006s sys 0.001s
I20260201 08:58:01.588366 14987 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.588837 14987 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.590824 14987 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.591480 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:01.591929 14848 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.592373 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.592963 14921 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 0.
I20260201 08:58:01.592993 14737 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.593772 14987 raft_consensus.cc:2804] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.594116 14987 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.594455 14987 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.595412 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.595993 14921 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 0.
I20260201 08:58:01.596951 14811 leader_election.cc:304] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.597762 14972 raft_consensus.cc:2804] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:01.598102 14972 raft_consensus.cc:493] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:01.598434 14972 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.600361 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:01.600937 14773 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 0.
I20260201 08:58:01.603605 14987 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.603605 14972 raft_consensus.cc:515] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.605274 14972 leader_election.cc:290] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 1 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.605975 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:01.606510 14773 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.606596 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.607040 14921 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.606596 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.609491 14848 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.609567 14987 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.611701 14773 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 1.
I20260201 08:58:01.612046 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.612556 14922 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.612820 14813 leader_election.cc:304] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.612846 14921 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 1.
I20260201 08:58:01.613816 14972 raft_consensus.cc:2804] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.614921 14972 raft_consensus.cc:697] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:01.615890 14848 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.615797 14972 consensus_queue.cc:237] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.616848 14737 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.617486 14987 raft_consensus.cc:2804] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:01.618623 14987 raft_consensus.cc:697] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.618719 14922 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 1.
I20260201 08:58:01.619522 14987 consensus_queue.cc:237] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.623908 14972 raft_consensus.cc:493] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:01.624436 14972 raft_consensus.cc:515] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.625015 14671 catalog_manager.cc:5654] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 0 to 1, leader changed from <none> to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.626147 14972 leader_election.cc:290] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.627243 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:01.627239 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:01.628084 14922 raft_consensus.cc:2393] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate baa9855381ce480a8590db2271c1b470 in current term 1: Already voted for candidate 9d02cc37a80544249ab6060617f30a8d in this term.
I20260201 08:58:01.627801 14669 catalog_manager.cc:5654] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 1 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.629207 14811 leader_election.cc:304] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:01.630108 14972 raft_consensus.cc:3060] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.635673 14972 raft_consensus.cc:2749] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:01.711726 14987 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.722487 14848 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:01.729826 14990 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.810617 14922 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:50378
I20260201 08:58:01.811160 14922 raft_consensus.cc:606] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:01.814810 14990 consensus_queue.cc:1048] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.816331 14922 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:50378
I20260201 08:58:01.816789 14922 raft_consensus.cc:606] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:01.820331 14990 consensus_queue.cc:1048] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.826440 14990 consensus_queue.cc:1048] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.837692 14971 consensus_queue.cc:1048] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.847195 14773 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "32153f11aaef4157912baebcca102ccc"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:36818
I20260201 08:58:01.847797 14773 raft_consensus.cc:606] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Received request to transfer leadership to TS baa9855381ce480a8590db2271c1b470
I20260201 08:58:01.853806 14990 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.858536 14773 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:36818
I20260201 08:58:01.859100 14773 raft_consensus.cc:606] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Received request to transfer leadership to TS baa9855381ce480a8590db2271c1b470
I20260201 08:58:01.869024 14773 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "892bd3aede9b45098921d309c961a816"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:36818
I20260201 08:58:01.869567 14773 raft_consensus.cc:606] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Received request to transfer leadership to TS baa9855381ce480a8590db2271c1b470
I20260201 08:58:01.873533 14971 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.874611 14773 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:36818
I20260201 08:58:01.875187 14773 raft_consensus.cc:606] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Received request to transfer leadership to TS ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:01.880314 14990 raft_consensus.cc:993] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:01.880707 14971 raft_consensus.cc:1081] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Signalling peer baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:01.882899 14848 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:53606
I20260201 08:58:01.883497 14848 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:01.883862 14848 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.888331 14848 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.889845 14848 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.890622 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:01.890861 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.891207 14773 raft_consensus.cc:3055] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:01.891425 14922 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.891583 14773 raft_consensus.cc:740] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.892351 14773 consensus_queue.cc:260] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.893620 14773 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.898090 14922 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
I20260201 08:58:01.899127 14811 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.899636 14773 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
I20260201 08:58:01.899788 14972 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:01.900259 14972 raft_consensus.cc:697] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:01.901067 14972 consensus_queue.cc:237] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.906620 14671 catalog_manager.cc:5654] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 1 to 2, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.932968 15011 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.939508 15002 raft_consensus.cc:993] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:01.939924 15002 raft_consensus.cc:1081] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:01.941720 14772 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36794
I20260201 08:58:01.942754 14772 raft_consensus.cc:493] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:01.943121 14772 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.945668 15011 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.949714 14772 raft_consensus.cc:515] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.952502 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.953110 14847 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.955449 15011 consensus_queue.cc:1048] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.958707 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.959367 14922 raft_consensus.cc:3055] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:01.959697 14847 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 2.
I20260201 08:58:01.959744 14922 raft_consensus.cc:740] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:01.960942 14737 leader_election.cc:304] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:01.961917 14971 raft_consensus.cc:2804] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:01.962414 14971 raft_consensus.cc:697] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:01.962018 14922 consensus_queue.cc:260] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.963203 14971 consensus_queue.cc:237] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.964066 14922 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.969487 14772 leader_election.cc:290] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 2 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.971984 14671 catalog_manager.cc:5654] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 1 to 2, leader changed from ae718f3470d54aaca7f5fb973000014f (127.13.194.67) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 2 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:01.976414 14922 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 2.
I20260201 08:58:01.977833 15002 consensus_queue.cc:1048] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.987200 14970 raft_consensus.cc:993] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:01.987589 15002 raft_consensus.cc:1081] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:01.988816 14772 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36794
I20260201 08:58:01.989300 14772 raft_consensus.cc:493] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:01.989563 14772 raft_consensus.cc:3060] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.993903 14772 raft_consensus.cc:515] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:01.995437 14772 leader_election.cc:290] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 2 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:01.996762 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:01.997442 14922 raft_consensus.cc:3055] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:01.997162 14848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:01.998139 14922 raft_consensus.cc:740] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:01.998584 14971 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:01.999236 14848 raft_consensus.cc:3060] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:01.999001 14922 consensus_queue.cc:260] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.000312 14922 raft_consensus.cc:3060] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.006279 14922 raft_consensus.cc:2468] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 2.
I20260201 08:58:02.006464 14848 raft_consensus.cc:2468] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 2.
I20260201 08:58:02.007462 14736 leader_election.cc:304] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:02.008374 14990 raft_consensus.cc:2804] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:02.008803 14990 raft_consensus.cc:697] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:02.009622 14990 consensus_queue.cc:237] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.011108 14987 raft_consensus.cc:993] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:02.011575 14987 raft_consensus.cc:1081] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Signalling peer baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:02.012898 14966 consensus_queue.cc:1048] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:02.013777 14847 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "32153f11aaef4157912baebcca102ccc"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:53606
I20260201 08:58:02.014339 14847 raft_consensus.cc:493] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:02.014744 14847 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.014842 14922 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:02.018903 14671 catalog_manager.cc:5654] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 1 to 2, leader changed from ae718f3470d54aaca7f5fb973000014f (127.13.194.67) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 2 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:02.023748 14990 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:02.034880 14847 raft_consensus.cc:515] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.036094 14848 raft_consensus.cc:1240] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Rejecting Update request from peer 9d02cc37a80544249ab6060617f30a8d for earlier term 1. Current term is 2. Ops: []
I20260201 08:58:02.041040 14847 leader_election.cc:290] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:02.041704 15040 consensus_queue.cc:1048] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:02.042061 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:02.042181 14990 consensus_queue.cc:1059] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:02.043000 14772 raft_consensus.cc:3055] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:02.043352 14772 raft_consensus.cc:740] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:02.044287 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:02.044112 14772 consensus_queue.cc:260] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.044836 14922 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.045379 14772 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.052145 14772 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
W20260201 08:58:02.053139 14966 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260201 08:58:02.052145 14922 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
I20260201 08:58:02.054849 14811 leader_election.cc:304] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:02.055821 14972 raft_consensus.cc:2804] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:02.056278 14972 raft_consensus.cc:697] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:02.056834 14972 consensus_queue.cc:237] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.063241 14671 catalog_manager.cc:5654] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 1 to 2, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:02.129736 14972 consensus_queue.cc:1048] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:02.140069 15045 consensus_queue.cc:1048] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:02.186810 14990 consensus_queue.cc:1048] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:02.187511 14966 consensus_queue.cc:1048] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:02.199397 15040 raft_consensus.cc:993] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:02.199975 15040 raft_consensus.cc:1081] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Signalling peer baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:02.203008 14847 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "892bd3aede9b45098921d309c961a816"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:53606
I20260201 08:58:02.203599 14847 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:02.204015 14847 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.209800 14847 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.211328 14847 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:02.211946 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:02.212250 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:02.212447 14772 raft_consensus.cc:3055] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:02.212805 14921 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.212783 14772 raft_consensus.cc:740] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:02.213686 14772 consensus_queue.cc:260] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.214653 14772 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.218451 14921 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
I20260201 08:58:02.219187 14772 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
I20260201 08:58:02.219441 14811 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:02.220264 15045 raft_consensus.cc:2804] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:02.220669 15045 raft_consensus.cc:697] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:02.221379 15045 consensus_queue.cc:237] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.227878 14670 catalog_manager.cc:5654] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 1 to 2, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:02.296075 14772 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.297295 15045 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.304697 14921 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.305939 14972 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.322388 14987 raft_consensus.cc:993] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:02.322783 15040 raft_consensus.cc:1081] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Signalling peer ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:02.324535 14921 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:50366
I20260201 08:58:02.325080 14921 raft_consensus.cc:493] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:02.325371 14921 raft_consensus.cc:3060] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.329893 14921 raft_consensus.cc:515] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.331327 14921 leader_election.cc:290] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:02.332232 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:02.332306 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:02.332726 14772 raft_consensus.cc:3055] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:02.332778 14847 raft_consensus.cc:3060] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.333050 14772 raft_consensus.cc:740] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:02.333680 14772 consensus_queue.cc:260] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.335114 14772 raft_consensus.cc:3060] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:02.337496 14847 raft_consensus.cc:2468] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:02.338506 14886 leader_election.cc:304] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:02.339151 15002 raft_consensus.cc:2804] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:02.339529 15002 raft_consensus.cc:697] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:02.339815 14772 raft_consensus.cc:2468] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:02.340296 15002 consensus_queue.cc:237] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:02.343362 14921 raft_consensus.cc:1275] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.344485 15040 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.348774 14669 catalog_manager.cc:5654] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 1 to 2, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 2 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:02.354688 14847 raft_consensus.cc:1275] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.356910 14990 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.551051 14921 raft_consensus.cc:1275] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.552208 14990 consensus_queue.cc:1048] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.560374 14847 raft_consensus.cc:1275] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.561937 14987 consensus_queue.cc:1048] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.624415 14772 raft_consensus.cc:1275] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.625648 15045 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.633317 14921 raft_consensus.cc:1275] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.635572 15045 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.707919 14772 raft_consensus.cc:1275] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.709103 15045 consensus_queue.cc:1048] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.716467 14921 raft_consensus.cc:1275] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.717921 15020 consensus_queue.cc:1048] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.727664 14847 raft_consensus.cc:1275] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.728788 15002 consensus_queue.cc:1048] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:02.737407 14772 raft_consensus.cc:1275] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:02.738554 15002 consensus_queue.cc:1048] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:04.905444 14089 auto_leader_rebalancer-test.cc:343] The leader distribution is
I20260201 08:58:04.906028 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:04.922288 14772 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:36824
I20260201 08:58:04.922776 14772 raft_consensus.cc:606] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Received request to transfer leadership to TS ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:04.924759 14772 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:36824
I20260201 08:58:04.925246 14772 raft_consensus.cc:606] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Received request to transfer leadership to TS ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:04.926095 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260201 08:58:04.926606 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:05.221387 15052 raft_consensus.cc:993] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:05.221915 15056 raft_consensus.cc:1081] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Signalling peer ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:05.223407 14921 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:50366
I20260201 08:58:05.223874 14921 raft_consensus.cc:493] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:05.224156 14921 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:05.229236 15052 raft_consensus.cc:993] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:05.229719 15056 raft_consensus.cc:1081] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Signalling peer ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:05.229852 14921 raft_consensus.cc:515] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:05.231268 14922 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:50366
I20260201 08:58:05.231796 14922 raft_consensus.cc:493] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:05.232126 14922 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:05.232743 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:05.233208 14921 leader_election.cc:290] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:05.233337 14772 raft_consensus.cc:3055] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:05.232880 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:05.233691 14772 raft_consensus.cc:740] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:05.233942 14847 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:05.234452 14772 consensus_queue.cc:260] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:05.235626 14772 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:05.238560 14847 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 3.
I20260201 08:58:05.238632 14922 raft_consensus.cc:515] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:05.239540 14886 leader_election.cc:304] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:05.240160 15051 raft_consensus.cc:2804] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:58:05.240515 14922 leader_election.cc:290] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637)
I20260201 08:58:05.241238 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:05.241868 14847 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:05.242106 14772 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 3.
I20260201 08:58:05.243743 15051 raft_consensus.cc:697] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:05.243981 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:05.244453 14772 raft_consensus.cc:3055] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:05.244691 14772 raft_consensus.cc:740] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:05.244621 15051 consensus_queue.cc:237] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:05.245371 14772 consensus_queue.cc:260] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:05.246328 14772 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:05.251705 14847 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:05.252599 14886 leader_election.cc:304] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:05.253258 15051 raft_consensus.cc:2804] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:05.252768 14671 catalog_manager.cc:5654] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 2 to 3, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 3 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:05.253621 15051 raft_consensus.cc:697] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:05.254307 15051 consensus_queue.cc:237] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:05.255635 14772 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:05.268110 14671 catalog_manager.cc:5654] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 1 to 2, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 2 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:05.647349 14847 raft_consensus.cc:1275] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:05.648612 15051 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:05.658497 14772 raft_consensus.cc:1275] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:05.660082 15066 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:05.696172 14847 raft_consensus.cc:1275] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:05.697350 15066 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:05.704665 14772 raft_consensus.cc:1275] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:05.706130 15051 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:05.927412 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:05.932817 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:05.933202 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:06.934038 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:06.940176 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:06.940538 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:07.941358 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:07.947132 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:07.947521 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:08.948555 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:08.954957 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:08.955365 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:09.956380 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:09.961854 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:09.962307 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:10.963268 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:10.968448 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:10.968837 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:11.969661 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:11.974793 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:11.975210 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:12.975953 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:12.981074 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:12.981489 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:13.982326 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:13.987560 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:13.987986 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:15.016966 14089 auto_leader_rebalancer-test.cc:362] The leader distribution is
I20260201 08:58:15.020992 14922 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:50378
I20260201 08:58:15.021546 14922 raft_consensus.cc:606] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:15.028153 14922 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:50378
I20260201 08:58:15.028569 14922 raft_consensus.cc:606] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:15.050083 14847 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "32153f11aaef4157912baebcca102ccc"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:43424
I20260201 08:58:15.050530 14847 raft_consensus.cc:606] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:15.055096 14847 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:43424
I20260201 08:58:15.055510 14847 raft_consensus.cc:606] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:15.059723 14847 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:43424
I20260201 08:58:15.060197 14847 raft_consensus.cc:606] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:15.077986 15081 raft_consensus.cc:993] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.078480 15075 raft_consensus.cc:1081] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.079830 14773 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36810
I20260201 08:58:15.080302 14773 raft_consensus.cc:493] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:15.080612 14773 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:15.085898 14773 raft_consensus.cc:515] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.087549 14773 leader_election.cc:290] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 2 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:15.088539 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:15.088538 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:15.089345 14922 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:15.089394 14847 raft_consensus.cc:3055] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:15.089783 14847 raft_consensus.cc:740] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:15.090579 14847 consensus_queue.cc:260] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.093500 14847 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:15.095436 14922 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 2.
I20260201 08:58:15.096443 14736 leader_election.cc:304] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:15.097229 15056 raft_consensus.cc:2804] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:15.097690 15056 raft_consensus.cc:697] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:15.098208 14847 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 2.
I20260201 08:58:15.098565 15056 consensus_queue.cc:237] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.105830 14669 catalog_manager.cc:5654] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 1 to 2, leader changed from baa9855381ce480a8590db2271c1b470 (127.13.194.66) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 2 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:15.155081 15081 raft_consensus.cc:993] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.155500 15081 raft_consensus.cc:1081] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.156772 14773 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36810
I20260201 08:58:15.157230 14773 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:15.157469 14773 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.162336 14773 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.163805 14773 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:15.164642 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:15.164726 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:15.165196 14847 raft_consensus.cc:3055] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:15.165225 14922 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.165510 14847 raft_consensus.cc:740] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:15.166149 14847 consensus_queue.cc:260] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.166949 14847 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.169525 14922 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 3.
I20260201 08:58:15.170367 14736 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:15.170990 15056 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:58:15.171010 14847 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 3.
I20260201 08:58:15.171432 15056 raft_consensus.cc:697] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:15.172144 15056 consensus_queue.cc:237] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.178143 14669 catalog_manager.cc:5654] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 2 to 3, leader changed from baa9855381ce480a8590db2271c1b470 (127.13.194.66) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 3 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:15.316294 15075 raft_consensus.cc:993] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.316675 15081 raft_consensus.cc:1081] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.317891 14773 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "32153f11aaef4157912baebcca102ccc"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36810
I20260201 08:58:15.318360 14773 raft_consensus.cc:493] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:15.318634 14773 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.323580 14773 raft_consensus.cc:515] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.324994 14773 leader_election.cc:290] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:15.325738 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:15.325876 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:15.326220 14847 raft_consensus.cc:3055] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:15.326371 14922 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.326581 14847 raft_consensus.cc:740] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:15.327270 14847 consensus_queue.cc:260] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.328088 14847 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.330634 14922 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 3.
I20260201 08:58:15.331576 14736 leader_election.cc:304] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:15.332301 15056 raft_consensus.cc:2804] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:58:15.332628 15056 raft_consensus.cc:697] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:15.333385 15056 consensus_queue.cc:237] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.333585 14847 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 3.
I20260201 08:58:15.339226 14669 catalog_manager.cc:5654] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 2 to 3, leader changed from baa9855381ce480a8590db2271c1b470 (127.13.194.66) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 3 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:15.430367 15078 raft_consensus.cc:993] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.430871 15091 raft_consensus.cc:1081] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.432241 14773 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36794
I20260201 08:58:15.432657 14773 raft_consensus.cc:493] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:15.432946 14773 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:15.437350 14773 raft_consensus.cc:515] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.438828 14773 leader_election.cc:290] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:15.439610 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:15.440028 14847 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:15.439960 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:15.440478 14922 raft_consensus.cc:3055] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:58:15.440703 14922 raft_consensus.cc:740] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:15.441262 14922 consensus_queue.cc:260] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.442106 14922 raft_consensus.cc:3060] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:15.444571 14847 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 4.
I20260201 08:58:15.445593 14737 leader_election.cc:304] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:15.446311 15056 raft_consensus.cc:2804] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:58:15.446645 15056 raft_consensus.cc:697] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 4 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:15.446710 14922 raft_consensus.cc:2468] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 4.
I20260201 08:58:15.447491 15056 consensus_queue.cc:237] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.453758 14669 catalog_manager.cc:5654] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 3 to 4, leader changed from ae718f3470d54aaca7f5fb973000014f (127.13.194.67) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 4 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:15.495352 14847 raft_consensus.cc:1275] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:15.496488 15056 consensus_queue.cc:1048] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:15.505856 14922 raft_consensus.cc:1275] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:58:15.507404 15056 consensus_queue.cc:1048] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:15.512948 15078 raft_consensus.cc:993] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.516111 15091 raft_consensus.cc:1081] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:15.517668 14772 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36794
I20260201 08:58:15.518107 14772 raft_consensus.cc:493] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:15.518436 14772 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.522818 14772 raft_consensus.cc:515] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.524035 14772 leader_election.cc:290] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:15.524936 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:15.525038 14846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:15.525553 14922 raft_consensus.cc:3055] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:15.525656 14846 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.525868 14922 raft_consensus.cc:740] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:15.526520 14922 consensus_queue.cc:260] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.527361 14922 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:15.530442 14846 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 3.
I20260201 08:58:15.531255 14737 leader_election.cc:304] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:15.531473 14922 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 3.
I20260201 08:58:15.531859 15056 raft_consensus.cc:2804] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:58:15.532233 15056 raft_consensus.cc:697] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:15.532845 15056 consensus_queue.cc:237] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:15.538908 14671 catalog_manager.cc:5654] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 2 to 3, leader changed from ae718f3470d54aaca7f5fb973000014f (127.13.194.67) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 3 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:15.699059 14846 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:15.700120 15056 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:15.709839 14922 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:15.710927 15056 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:15.757977 14846 raft_consensus.cc:1275] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:15.759063 15056 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:15.766870 14922 raft_consensus.cc:1275] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:15.768476 15104 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:15.948684 14846 raft_consensus.cc:1275] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:15.949858 15101 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:15.952711 14847 raft_consensus.cc:1275] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:15.954744 15101 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:15.958777 14921 raft_consensus.cc:1275] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:15.960224 15056 consensus_queue.cc:1048] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:15.973977 14921 raft_consensus.cc:1275] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:15.975387 15104 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:18.092804 14089 auto_leader_rebalancer-test.cc:377] The leader distribution is
I20260201 08:58:18.093407 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:18.101429 14772 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "32153f11aaef4157912baebcca102ccc"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:36824
I20260201 08:58:18.101929 14772 raft_consensus.cc:606] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Received request to transfer leadership to TS baa9855381ce480a8590db2271c1b470
I20260201 08:58:18.103997 14772 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:36824
I20260201 08:58:18.104414 14772 raft_consensus.cc:606] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Received request to transfer leadership to TS baa9855381ce480a8590db2271c1b470
I20260201 08:58:18.106326 14772 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:36824
I20260201 08:58:18.106774 14772 raft_consensus.cc:606] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Received request to transfer leadership to TS ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:18.108651 14772 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
mode: GRACEFUL
new_leader_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:36824
I20260201 08:58:18.109107 14772 raft_consensus.cc:606] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Received request to transfer leadership to TS ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:18.109850 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260201 08:58:18.110246 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:18.165259 15111 raft_consensus.cc:993] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:18.165726 15104 raft_consensus.cc:1081] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Signalling peer ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:18.167047 14921 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:50366
I20260201 08:58:18.167447 14921 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:18.167683 14921 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.172188 14921 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.173843 14921 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 4 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:18.174543 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:18.174754 14846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:18.175074 14772 raft_consensus.cc:3055] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:58:18.175237 14846 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.175349 14772 raft_consensus.cc:740] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:18.175983 14772 consensus_queue.cc:260] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.176743 14772 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.179734 14846 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 4.
I20260201 08:58:18.180408 14772 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 4.
I20260201 08:58:18.180760 14886 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:18.181459 15091 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:58:18.182192 15091 raft_consensus.cc:697] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 4 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:18.182922 15091 consensus_queue.cc:237] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.188401 14669 catalog_manager.cc:5654] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 3 to 4, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 4 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:18.505283 15111 raft_consensus.cc:993] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:18.506620 15104 raft_consensus.cc:1081] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Signalling peer baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:18.509542 14846 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:53606
I20260201 08:58:18.510517 14846 raft_consensus.cc:493] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:18.510993 14846 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.518493 15111 raft_consensus.cc:993] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:18.519141 15104 raft_consensus.cc:1081] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Signalling peer ae718f3470d54aaca7f5fb973000014f to start an election
I20260201 08:58:18.520686 14921 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f"
dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
from {username='slave'} at 127.0.0.1:50366
I20260201 08:58:18.521135 14921 raft_consensus.cc:493] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:18.521377 14921 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:18.521608 14846 raft_consensus.cc:515] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.526103 14846 leader_election.cc:290] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:18.526667 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:18.527498 14772 raft_consensus.cc:3055] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:58:18.526748 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:18.527802 14772 raft_consensus.cc:740] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:18.528173 14922 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.527860 14921 raft_consensus.cc:515] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.528697 14772 consensus_queue.cc:260] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.530252 14921 leader_election.cc:290] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:18.530246 14772 raft_consensus.cc:3060] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.533057 14846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:18.533190 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:18.533854 14773 raft_consensus.cc:3055] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:18.533885 14846 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:18.534303 14773 raft_consensus.cc:740] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:18.535542 14922 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 4.
I20260201 08:58:18.535229 14773 consensus_queue.cc:260] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.536751 14773 raft_consensus.cc:3060] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:18.536880 14811 leader_election.cc:304] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:18.537869 15081 raft_consensus.cc:2804] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:58:18.538880 14772 raft_consensus.cc:2468] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 4.
I20260201 08:58:18.540205 15081 raft_consensus.cc:697] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 4 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:18.541467 15081 consensus_queue.cc:237] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.543184 14846 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 3.
I20260201 08:58:18.544559 14773 raft_consensus.cc:2468] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 3.
I20260201 08:58:18.544997 14886 leader_election.cc:304] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:18.546736 15091 raft_consensus.cc:2804] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:58:18.547187 15091 raft_consensus.cc:697] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 3 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:18.548017 15091 consensus_queue.cc:237] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.551505 14669 catalog_manager.cc:5654] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 3 to 4, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 4 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:18.557456 14671 catalog_manager.cc:5654] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 2 to 3, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 3 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:18.567780 14846 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:18.568765 15091 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:18.578509 14773 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:18.580325 15112 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:18.644299 15104 raft_consensus.cc:993] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: : Instructing follower baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:18.644776 15111 raft_consensus.cc:1081] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Signalling peer baa9855381ce480a8590db2271c1b470 to start an election
I20260201 08:58:18.646131 14846 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "32153f11aaef4157912baebcca102ccc"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
from {username='slave'} at 127.0.0.1:53606
I20260201 08:58:18.646584 14846 raft_consensus.cc:493] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:18.646850 14846 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.651399 14846 raft_consensus.cc:515] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.652809 14846 leader_election.cc:290] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:18.653586 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:18.653676 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:18.654167 14773 raft_consensus.cc:3055] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:58:18.654284 14922 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.654458 14773 raft_consensus.cc:740] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:18.655133 14773 consensus_queue.cc:260] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.656047 14773 raft_consensus.cc:3060] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:18.658424 14922 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 4.
I20260201 08:58:18.659260 14811 leader_election.cc:304] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:18.659832 15081 raft_consensus.cc:2804] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:58:18.660290 15081 raft_consensus.cc:697] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 4 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:18.660722 14773 raft_consensus.cc:2468] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 4.
I20260201 08:58:18.661285 15081 consensus_queue.cc:237] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:18.668303 14669 catalog_manager.cc:5654] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 3 to 4, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 4 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:18.948721 14773 raft_consensus.cc:1275] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:18.949867 15081 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:18.957687 14922 raft_consensus.cc:1275] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:18.959908 15120 consensus_queue.cc:1048] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:19.019786 14773 raft_consensus.cc:1275] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:19.020892 15112 consensus_queue.cc:1048] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:19.028941 14846 raft_consensus.cc:1275] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:58:19.031193 15133 consensus_queue.cc:1048] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:19.040598 14773 raft_consensus.cc:1275] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:19.041615 15120 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:19.050047 14922 raft_consensus.cc:1275] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:58:19.051383 15120 consensus_queue.cc:1048] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:19.111284 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:19.116909 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:19.117274 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:20.118153 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:20.123225 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:20.123598 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:21.124425 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:21.130195 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:21.130551 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:22.131268 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:22.136605 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:22.137006 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:23.137861 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:23.143374 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:23.143865 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:25.090638 15141 raft_consensus.cc:493] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae718f3470d54aaca7f5fb973000014f)
I20260201 08:58:25.091339 15141 raft_consensus.cc:515] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.093688 15141 leader_election.cc:290] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.125135 15141 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ae718f3470d54aaca7f5fb973000014f)
I20260201 08:58:25.147502 15141 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.166350 15142 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa9855381ce480a8590db2271c1b470)
I20260201 08:58:25.170470 15145 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader baa9855381ce480a8590db2271c1b470)
I20260201 08:58:25.179957 15145 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.180790 15143 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:25.181352 15141 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.181284 15143 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.181927 15145 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:25.175474 15147 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ae718f3470d54aaca7f5fb973000014f)
I20260201 08:58:25.183279 15143 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.183938 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.184259 15142 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.178983 15149 raft_consensus.cc:493] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ae718f3470d54aaca7f5fb973000014f)
I20260201 08:58:25.185082 15149 raft_consensus.cc:515] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.186457 15142 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.186905 15142 raft_consensus.cc:493] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ae718f3470d54aaca7f5fb973000014f)
I20260201 08:58:25.183248 15148 raft_consensus.cc:493] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa9855381ce480a8590db2271c1b470)
I20260201 08:58:25.184363 15147 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.186980 15149 leader_election.cc:290] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.187433 15142 raft_consensus.cc:515] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.187521 15148 raft_consensus.cc:515] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.189548 15142 leader_election.cc:290] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.189702 15147 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.191288 15148 leader_election.cc:290] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.198063 15145 raft_consensus.cc:493] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:25.198556 15145 raft_consensus.cc:515] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.202247 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.203949 15145 leader_election.cc:290] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:25.207567 15148 raft_consensus.cc:493] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader baa9855381ce480a8590db2271c1b470)
I20260201 08:58:25.208142 15148 raft_consensus.cc:515] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.210561 15148 leader_election.cc:290] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.211359 15152 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:25.212224 15152 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.212586 15141 raft_consensus.cc:493] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:25.214322 15141 raft_consensus.cc:515] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.215409 15152 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.216288 15141 leader_election.cc:290] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.218649 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.219192 14772 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:25.220813 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1265b5459a54ca6ba94cd958f4c60b5" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.224926 14887 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters: baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.226101 15151 raft_consensus.cc:2804] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:58:25.226490 15151 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting leader election (detected failure of leader baa9855381ce480a8590db2271c1b470)
I20260201 08:58:25.227046 15151 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:25.226437 14887 leader_election.cc:304] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f; no voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.229097 15145 raft_consensus.cc:2749] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:58:25.234783 15151 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.236970 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.238303 14846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:25.238569 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.239104 14772 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.239686 15151 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:25.240381 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.241310 15151 raft_consensus.cc:493] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:25.241786 15151 raft_consensus.cc:515] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.242241 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.243456 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.243498 14846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.244086 14773 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 4.
I20260201 08:58:25.245684 15151 leader_election.cc:290] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:25.249106 14920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.245890 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.260049 14920 raft_consensus.cc:2468] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 1.
I20260201 08:58:25.245527 14846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.248224 14918 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.261412 14918 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 1.
I20260201 08:58:25.247141 14921 raft_consensus.cc:1240] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Rejecting Update request from peer baa9855381ce480a8590db2271c1b470 for earlier term 2. Current term is 3. Ops: []
I20260201 08:58:25.251367 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.247706 14919 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.244820 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:25.264195 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.265956 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.266157 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.266158 14813 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:25.267791 15153 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:58:25.268255 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a9feb07deb0485ca0233f18808edf06" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.268553 14922 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.268162 14920 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d38bfe89dbb4f92bb4d288968629f9f" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.269640 14915 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33cfe8c6817e4cc7a2bc0f6ab7504d60" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.270081 14921 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32153f11aaef4157912baebcca102ccc" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.271270 14918 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:25.268146 15153 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ae718f3470d54aaca7f5fb973000014f)
I20260201 08:58:25.272509 15153 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:58:25.273941 14737 leader_election.cc:304] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d; no voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.271986 14918 raft_consensus.cc:2393] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d02cc37a80544249ab6060617f30a8d in current term 3: Already voted for candidate ae718f3470d54aaca7f5fb973000014f in this term.
I20260201 08:58:25.274992 14737 leader_election.cc:304] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d; no voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.275517 14736 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d; no voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.274950 15147 raft_consensus.cc:2749] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:58:25.275831 15142 raft_consensus.cc:2749] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:58:25.276268 15147 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:25.277084 14737 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d; no voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.277885 15142 raft_consensus.cc:2749] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:58:25.278966 14737 leader_election.cc:304] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d; no voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.279687 15142 raft_consensus.cc:2749] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260201 08:58:25.280019 14887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:42637, user_credentials={real_user=slave}} blocked reactor thread for 51501.8us
I20260201 08:58:25.280771 14737 leader_election.cc:304] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d; no voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.281554 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:25.283253 15148 raft_consensus.cc:2749] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:58:25.283674 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d82268dbf5484caba89dc55f3761892c" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:25.283982 15147 raft_consensus.cc:2749] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:58:25.271950 14811 leader_election.cc:304] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:25.284830 15143 raft_consensus.cc:2749] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:58:25.285137 14887 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f; no voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.286027 15145 raft_consensus.cc:2749] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:58:25.285210 14811 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters:
I20260201 08:58:25.287199 15143 raft_consensus.cc:2804] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:58:25.287631 15143 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:25.287539 14811 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:25.287961 15143 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:25.287252 14887 leader_election.cc:304] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f; no voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470
I20260201 08:58:25.288425 15146 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:58:25.288753 15146 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:25.289068 14811 leader_election.cc:304] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:25.288766 15141 consensus_queue.cc:1059] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:25.289112 15146 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:25.289852 15152 raft_consensus.cc:2749] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:58:25.289135 15154 raft_consensus.cc:2749] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:58:25.284159 15153 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.295174 15153 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 5 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.295802 15143 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.295089 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:25.296427 14918 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:25.297883 14811 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:25.299137 15152 raft_consensus.cc:3055] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:25.299481 15152 raft_consensus.cc:740] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:25.299572 15146 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.300486 15156 raft_consensus.cc:2749] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:58:25.300272 15152 consensus_queue.cc:260] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.300606 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:25.301378 15143 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.301321 14918 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:25.302124 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:25.302826 14811 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:25.303295 15152 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:25.302980 15146 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:25.303565 15143 raft_consensus.cc:2749] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:58:25.303515 14918 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:25.304844 14811 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:25.305599 15143 raft_consensus.cc:2749] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:58:25.531982 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:25.537803 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:25.538308 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:25.647863 14847 raft_consensus.cc:1240] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Rejecting Update request from peer 9d02cc37a80544249ab6060617f30a8d for earlier term 1. Current term is 2. Ops: []
I20260201 08:58:25.649016 15147 consensus_queue.cc:1059] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:25.650031 15148 raft_consensus.cc:3055] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:25.650339 15148 raft_consensus.cc:740] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:25.651119 15148 consensus_queue.cc:260] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.652029 15148 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:25.729677 14847 raft_consensus.cc:1240] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Rejecting Update request from peer 9d02cc37a80544249ab6060617f30a8d for earlier term 1. Current term is 2. Ops: []
I20260201 08:58:25.730700 15148 consensus_queue.cc:1059] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:25.731498 15147 raft_consensus.cc:3055] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:25.731792 15147 raft_consensus.cc:740] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:25.732375 15147 consensus_queue.cc:260] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.733274 15147 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:25.783237 14847 raft_consensus.cc:1240] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 5 FOLLOWER]: Rejecting Update request from peer ae718f3470d54aaca7f5fb973000014f for earlier term 4. Current term is 5. Ops: []
I20260201 08:58:25.784581 15154 consensus_queue.cc:1059] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:58:25.785331 15145 raft_consensus.cc:3055] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:58:25.785600 15145 raft_consensus.cc:740] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:25.786353 15145 consensus_queue.cc:260] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:25.787209 15145 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Advancing to term 5
W20260201 08:58:26.160050 14943 debug-util.cc:398] Leaking SignalData structure 0x7b08001a7aa0 after lost signal to thread 14092
W20260201 08:58:26.160935 14943 debug-util.cc:398] Leaking SignalData structure 0x7b08001ba380 after lost signal to thread 14705
W20260201 08:58:26.161715 14943 debug-util.cc:398] Leaking SignalData structure 0x7b0800120600 after lost signal to thread 14797
W20260201 08:58:26.162421 14943 debug-util.cc:398] Leaking SignalData structure 0x7b08000964c0 after lost signal to thread 14872
W20260201 08:58:26.163236 14943 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8f00 after lost signal to thread 14946
I20260201 08:58:26.539275 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:26.547339 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:26.547897 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:26.663084 15152 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:26.663648 15152 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:26.665640 15152 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:26.666329 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:26.666522 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:26.667167 14917 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 3.
I20260201 08:58:26.668172 14811 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:26.668746 15152 raft_consensus.cc:2804] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:58:26.669128 15152 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:26.669456 15152 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:26.677002 15152 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:26.678954 15152 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:26.679579 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:26.679804 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:26.680420 14917 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:26.687683 14917 raft_consensus.cc:2468] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 4.
I20260201 08:58:26.688738 14811 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:26.689528 15152 raft_consensus.cc:2804] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:58:26.690557 15152 raft_consensus.cc:697] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 4 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:26.691426 15152 consensus_queue.cc:237] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:26.702144 14671 catalog_manager.cc:5654] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:26.908805 15147 raft_consensus.cc:493] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:26.909415 15147 raft_consensus.cc:515] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:26.911388 15147 leader_election.cc:290] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:26.912081 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:26.912328 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "892bd3aede9b45098921d309c961a816" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:26.913015 14917 raft_consensus.cc:2393] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d02cc37a80544249ab6060617f30a8d in current term 4: Already voted for candidate baa9855381ce480a8590db2271c1b470 in this term.
I20260201 08:58:26.913826 14736 leader_election.cc:304] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d; no voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470
I20260201 08:58:26.914537 15147 raft_consensus.cc:3060] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:26.921363 15147 raft_consensus.cc:2749] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:58:27.037671 15145 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:27.038146 15145 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.040273 15145 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:27.041062 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:27.041297 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:27.041786 14847 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 5.
I20260201 08:58:27.042618 14886 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:27.043193 15145 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:58:27.043553 15145 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:27.043857 15145 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:58:27.050571 15145 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.052474 15145 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 6 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:27.053222 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:27.053427 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:27.053975 14847 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:58:27.060966 14847 raft_consensus.cc:2468] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 6.
I20260201 08:58:27.061906 14886 leader_election.cc:304] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae718f3470d54aaca7f5fb973000014f, baa9855381ce480a8590db2271c1b470; no voters: 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:27.062516 15145 raft_consensus.cc:2804] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:58:27.063675 15145 raft_consensus.cc:697] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 6 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:27.064550 15145 consensus_queue.cc:237] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.072662 14671 catalog_manager.cc:5654] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:27.077037 15163 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:27.077082 15145 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:27.077690 15163 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.077821 15145 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.079922 15163 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:27.080705 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:27.080832 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:27.081378 14770 raft_consensus.cc:2468] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:27.081378 14773 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:27.082775 15145 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:27.083552 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:27.082839 14887 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:27.084018 14846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:27.084309 14847 raft_consensus.cc:2393] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae718f3470d54aaca7f5fb973000014f in current term 2: Already voted for candidate baa9855381ce480a8590db2271c1b470 in this term.
I20260201 08:58:27.084709 14846 raft_consensus.cc:2393] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae718f3470d54aaca7f5fb973000014f in current term 2: Already voted for candidate baa9855381ce480a8590db2271c1b470 in this term.
I20260201 08:58:27.084599 14887 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:27.085443 15163 raft_consensus.cc:2804] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:58:27.085708 15163 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:27.085968 15163 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:27.086627 15145 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:58:27.086995 15145 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d02cc37a80544249ab6060617f30a8d)
I20260201 08:58:27.087349 15145 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:27.091233 15163 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.092823 15163 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:27.093662 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:27.093802 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:27.094501 14847 raft_consensus.cc:2393] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ae718f3470d54aaca7f5fb973000014f in current term 2: Already voted for candidate baa9855381ce480a8590db2271c1b470 in this term.
I20260201 08:58:27.095165 15145 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.097810 15145 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349)
I20260201 08:58:27.098426 14770 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:27.098764 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "ae718f3470d54aaca7f5fb973000014f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:27.099445 14847 raft_consensus.cc:2393] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ae718f3470d54aaca7f5fb973000014f in current term 2: Already voted for candidate baa9855381ce480a8590db2271c1b470 in this term.
I20260201 08:58:27.100060 14773 raft_consensus.cc:2468] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:27.101028 14887 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters: baa9855381ce480a8590db2271c1b470
I20260201 08:58:27.101642 15145 raft_consensus.cc:2804] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:27.102128 15145 raft_consensus.cc:697] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:27.102839 15145 consensus_queue.cc:237] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.106124 14770 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae718f3470d54aaca7f5fb973000014f in term 2.
I20260201 08:58:27.108776 14887 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters: baa9855381ce480a8590db2271c1b470
I20260201 08:58:27.109532 15145 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:27.109994 15145 raft_consensus.cc:697] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Becoming Leader. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:27.110846 15145 consensus_queue.cc:237] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.111450 14671 catalog_manager.cc:5654] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 1 to 2, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 2 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:27.123788 14671 catalog_manager.cc:5654] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f reported cstate change: term changed from 1 to 2, leader changed from 9d02cc37a80544249ab6060617f30a8d (127.13.194.65) to ae718f3470d54aaca7f5fb973000014f (127.13.194.67). New cstate: current_term: 2 leader_uuid: "ae718f3470d54aaca7f5fb973000014f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:27.151643 15147 raft_consensus.cc:493] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ae718f3470d54aaca7f5fb973000014f)
I20260201 08:58:27.152122 15147 raft_consensus.cc:515] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.154228 15147 leader_election.cc:290] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:27.154945 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "baa9855381ce480a8590db2271c1b470" is_pre_election: true
I20260201 08:58:27.155258 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39cb022e9f0a4f7689de3c5b3fa03eae" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:27.155669 14847 raft_consensus.cc:2368] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d02cc37a80544249ab6060617f30a8d for earlier term 5. Current term is 6.
I20260201 08:58:27.156565 14737 leader_election.cc:400] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Vote denied by peer baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349) with higher term. Message: Invalid argument: T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d02cc37a80544249ab6060617f30a8d for earlier term 5. Current term is 6.
I20260201 08:58:27.156769 14737 leader_election.cc:403] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:58:27.157335 15147 raft_consensus.cc:3060] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Advancing to term 6
I20260201 08:58:27.159116 14917 raft_consensus.cc:1275] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:58:27.160625 15157 consensus_queue.cc:1048] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:27.164150 15147 raft_consensus.cc:2749] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349) with higher term. Message: Invalid argument: T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d02cc37a80544249ab6060617f30a8d for earlier term 5. Current term is 6.
I20260201 08:58:27.171437 14773 raft_consensus.cc:1275] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:58:27.173457 15152 consensus_queue.cc:1048] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:27.334797 15152 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:27.335215 15152 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.336783 15152 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:27.337533 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:27.337746 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:27.338164 14773 raft_consensus.cc:2468] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
I20260201 08:58:27.338990 14813 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters: ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:27.339536 15152 raft_consensus.cc:2804] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:58:27.339849 15152 raft_consensus.cc:493] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:27.340092 15152 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:27.345494 15152 raft_consensus.cc:515] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.347064 15152 leader_election.cc:290] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:27.347870 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:27.348078 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c73128561a046e6adcbc3ed387310e4" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:27.348588 14773 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:27.353044 14773 raft_consensus.cc:2468] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 3.
I20260201 08:58:27.353842 14813 leader_election.cc:304] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters: ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:27.354420 15152 raft_consensus.cc:2804] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:58:27.354842 15152 raft_consensus.cc:697] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 3 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:27.355625 15152 consensus_queue.cc:237] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.362715 14669 catalog_manager.cc:5654] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 2 to 3, leader changed from ae718f3470d54aaca7f5fb973000014f (127.13.194.67) to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 3 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:27.396576 15152 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:27.397063 15152 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.398721 15152 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:27.399452 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d" is_pre_election: true
I20260201 08:58:27.399657 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f" is_pre_election: true
I20260201 08:58:27.400082 14773 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 2.
I20260201 08:58:27.401005 14813 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters: ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:27.401567 15152 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:58:27.401880 15152 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:27.402128 15152 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:27.406729 15152 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.408277 15152 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 election: Requested vote from peers 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:27.409017 14773 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
I20260201 08:58:27.409299 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "baa9855381ce480a8590db2271c1b470" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:27.409596 14773 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:27.413793 14773 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baa9855381ce480a8590db2271c1b470 in term 3.
I20260201 08:58:27.414546 14813 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, baa9855381ce480a8590db2271c1b470; no voters: ae718f3470d54aaca7f5fb973000014f
I20260201 08:58:27.415127 15152 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:58:27.415592 15152 raft_consensus.cc:697] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 LEADER]: Becoming Leader. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:27.417128 15152 consensus_queue.cc:237] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.425560 14669 catalog_manager.cc:5654] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 reported cstate change: term changed from 2 to 3, leader changed from ae718f3470d54aaca7f5fb973000014f (127.13.194.67) to baa9855381ce480a8590db2271c1b470 (127.13.194.66). New cstate: current_term: 3 leader_uuid: "baa9855381ce480a8590db2271c1b470" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:27.502559 14847 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 6 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 08:58:27.503643 15145 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:58:27.511430 14773 raft_consensus.cc:1275] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 6 FOLLOWER]: Refusing update from remote peer ae718f3470d54aaca7f5fb973000014f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 08:58:27.512912 15163 consensus_queue.cc:1048] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:58:27.521186 14770 raft_consensus.cc:1240] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Rejecting Update request from peer ae718f3470d54aaca7f5fb973000014f for earlier term 2. Current term is 3. Ops: []
I20260201 08:58:27.523097 15176 consensus_queue.cc:1059] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:27.524909 15163 raft_consensus.cc:3055] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:27.525272 15163 raft_consensus.cc:740] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:27.526033 15163 consensus_queue.cc:260] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.527590 15163 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:27.548905 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:27.587184 14847 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b0db090127504a04ad96b6f631941983"
dest_uuid: "baa9855381ce480a8590db2271c1b470"
mode: GRACEFUL
new_leader_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:41238
I20260201 08:58:27.587674 14847 raft_consensus.cc:606] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 LEADER]: Received request to transfer leadership to TS 9d02cc37a80544249ab6060617f30a8d
I20260201 08:58:27.588670 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260201 08:58:27.589244 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:27.626266 14773 raft_consensus.cc:1240] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Rejecting Update request from peer ae718f3470d54aaca7f5fb973000014f for earlier term 2. Current term is 3. Ops: []
I20260201 08:58:27.627847 15163 consensus_queue.cc:1059] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:27.628886 15176 raft_consensus.cc:3055] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:58:27.629232 15176 raft_consensus.cc:740] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae718f3470d54aaca7f5fb973000014f, State: Running, Role: LEADER
I20260201 08:58:27.630012 15176 consensus_queue.cc:260] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.631013 15176 raft_consensus.cc:3060] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:58:27.842226 14917 raft_consensus.cc:1275] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:58:27.842523 14917 pending_rounds.cc:85] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: Aborting all ops after (but not including) 1
I20260201 08:58:27.842770 14917 pending_rounds.cc:107] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:58:27.842984 14917 raft_consensus.cc:2889] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:58:27.844192 15180 consensus_queue.cc:1048] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:27.852228 14773 raft_consensus.cc:1275] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:58:27.853158 14917 raft_consensus.cc:1275] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:58:27.853538 14917 pending_rounds.cc:85] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: Aborting all ops after (but not including) 1
I20260201 08:58:27.853768 14917 pending_rounds.cc:107] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:58:27.853711 15157 consensus_queue.cc:1048] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:27.854084 14917 raft_consensus.cc:2889] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:58:27.857865 15157 consensus_queue.cc:1048] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:27.870832 14773 raft_consensus.cc:1275] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Refusing update from remote peer baa9855381ce480a8590db2271c1b470: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:58:27.872165 15152 consensus_queue.cc:1048] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:27.882256 15152 raft_consensus.cc:993] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470: : Instructing follower 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:27.882699 15180 raft_consensus.cc:1081] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 LEADER]: Signalling peer 9d02cc37a80544249ab6060617f30a8d to start an election
I20260201 08:58:27.884421 14770 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b0db090127504a04ad96b6f631941983"
dest_uuid: "9d02cc37a80544249ab6060617f30a8d"
from {username='slave'} at 127.0.0.1:36810
I20260201 08:58:27.885025 14770 raft_consensus.cc:493] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:27.885391 14770 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:27.892896 14770 raft_consensus.cc:515] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.895622 14847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "baa9855381ce480a8590db2271c1b470"
I20260201 08:58:27.895787 14917 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b0db090127504a04ad96b6f631941983" candidate_uuid: "9d02cc37a80544249ab6060617f30a8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ae718f3470d54aaca7f5fb973000014f"
I20260201 08:58:27.896170 14847 raft_consensus.cc:3055] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:58:27.896483 14847 raft_consensus.cc:740] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: baa9855381ce480a8590db2271c1b470, State: Running, Role: LEADER
I20260201 08:58:27.896667 14770 leader_election.cc:290] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 election: Requested vote from peers baa9855381ce480a8590db2271c1b470 (127.13.194.66:42349), ae718f3470d54aaca7f5fb973000014f (127.13.194.67:36941)
I20260201 08:58:27.896495 14917 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:27.898460 14847 consensus_queue.cc:260] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.899596 14847 raft_consensus.cc:3060] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:58:27.903774 14917 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 4.
I20260201 08:58:27.905009 14736 leader_election.cc:304] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d02cc37a80544249ab6060617f30a8d, ae718f3470d54aaca7f5fb973000014f; no voters:
I20260201 08:58:27.905779 15147 raft_consensus.cc:2804] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:58:27.907234 14847 raft_consensus.cc:2468] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d02cc37a80544249ab6060617f30a8d in term 4.
I20260201 08:58:27.909850 15147 raft_consensus.cc:697] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 4 LEADER]: Becoming Leader. State: Replica: 9d02cc37a80544249ab6060617f30a8d, State: Running, Role: LEADER
I20260201 08:58:27.911249 15147 consensus_queue.cc:237] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } }
I20260201 08:58:27.917325 14669 catalog_manager.cc:5654] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d reported cstate change: term changed from 3 to 4, leader changed from baa9855381ce480a8590db2271c1b470 (127.13.194.66) to 9d02cc37a80544249ab6060617f30a8d (127.13.194.65). New cstate: current_term: 4 leader_uuid: "9d02cc37a80544249ab6060617f30a8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9d02cc37a80544249ab6060617f30a8d" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 42637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:28.311600 14917 raft_consensus.cc:1275] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:58:28.312682 15147 consensus_queue.cc:1048] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae718f3470d54aaca7f5fb973000014f" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 36941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:28.320848 14847 raft_consensus.cc:1275] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Refusing update from remote peer 9d02cc37a80544249ab6060617f30a8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:58:28.324769 15186 consensus_queue.cc:1048] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "baa9855381ce480a8590db2271c1b470" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 42349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:28.590523 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:28.597244 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:58:28.597652 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:29.624933 14089 auto_leader_rebalancer-test.cc:388] The leader distribution is
I20260201 08:58:29.625444 14089 tablet_server.cc:178] TabletServer@127.13.194.65:0 shutting down...
I20260201 08:58:29.646133 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:58:29.646831 14089 tablet_replica.cc:333] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.647574 14089 raft_consensus.cc:2243] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.648195 14089 raft_consensus.cc:2272] T 892bd3aede9b45098921d309c961a816 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.650112 14089 tablet_replica.cc:333] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.650660 14089 raft_consensus.cc:2243] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.651079 14089 raft_consensus.cc:2272] T 4d38bfe89dbb4f92bb4d288968629f9f P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.653525 14089 tablet_replica.cc:333] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
W20260201 08:58:29.653523 14813 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260201 08:58:29.654217 14089 raft_consensus.cc:2243] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.655130 14089 raft_consensus.cc:2272] T f1265b5459a54ca6ba94cd958f4c60b5 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260201 08:58:29.656596 14813 consensus_peers.cc:597] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 -> Peer 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637): Couldn't send request to peer 9d02cc37a80544249ab6060617f30a8d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:29.657339 14089 tablet_replica.cc:333] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.657884 14089 raft_consensus.cc:2243] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.658337 14089 raft_consensus.cc:2272] T 3c73128561a046e6adcbc3ed387310e4 P 9d02cc37a80544249ab6060617f30a8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.660003 14089 tablet_replica.cc:333] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.660550 14089 raft_consensus.cc:2243] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 6 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.661013 14089 raft_consensus.cc:2272] T 39cb022e9f0a4f7689de3c5b3fa03eae P 9d02cc37a80544249ab6060617f30a8d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.662647 14089 tablet_replica.cc:333] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.663089 14089 raft_consensus.cc:2243] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.663479 14089 raft_consensus.cc:2272] T 5a9feb07deb0485ca0233f18808edf06 P 9d02cc37a80544249ab6060617f30a8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.665261 14089 tablet_replica.cc:333] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.665714 14089 raft_consensus.cc:2243] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.666455 14089 raft_consensus.cc:2272] T d82268dbf5484caba89dc55f3761892c P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.667961 14089 tablet_replica.cc:333] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.668394 14089 raft_consensus.cc:2243] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.668790 14089 raft_consensus.cc:2272] T 32153f11aaef4157912baebcca102ccc P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.670389 14089 tablet_replica.cc:333] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.670894 14089 raft_consensus.cc:2243] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.671267 14089 raft_consensus.cc:2272] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.673735 14089 tablet_replica.cc:333] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d: stopping tablet replica
I20260201 08:58:29.674182 14089 raft_consensus.cc:2243] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 4 LEADER]: Raft consensus shutting down.
W20260201 08:58:29.674799 15186 consensus_queue.cc:1175] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "baa9855381ce480a8590db2271c1b470" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 4 index: 3 } }
I20260201 08:58:29.675486 14089 raft_consensus.cc:2272] T b0db090127504a04ad96b6f631941983 P 9d02cc37a80544249ab6060617f30a8d [term 4 FOLLOWER]: Raft consensus is shut down!
W20260201 08:58:29.682232 14813 consensus_peers.cc:597] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 -> Peer 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637): Couldn't send request to peer 9d02cc37a80544249ab6060617f30a8d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:29.706069 14089 tablet_server.cc:195] TabletServer@127.13.194.65:0 shutdown complete.
I20260201 08:58:29.723915 14089 tablet_server.cc:178] TabletServer@127.13.194.66:0 shutting down...
I20260201 08:58:29.748797 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:58:29.749529 14089 tablet_replica.cc:333] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.750468 14089 raft_consensus.cc:2243] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.751454 14089 raft_consensus.cc:2272] T 892bd3aede9b45098921d309c961a816 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.753276 14089 tablet_replica.cc:333] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.753791 14089 raft_consensus.cc:2243] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.754513 14089 raft_consensus.cc:2272] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.756188 14089 tablet_replica.cc:333] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.756651 14089 raft_consensus.cc:2243] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.757099 14089 raft_consensus.cc:2272] T 4d38bfe89dbb4f92bb4d288968629f9f P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.758746 14089 tablet_replica.cc:333] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.759198 14089 raft_consensus.cc:2243] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.759562 14089 raft_consensus.cc:2272] T b0db090127504a04ad96b6f631941983 P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.761796 14089 tablet_replica.cc:333] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.762476 14089 raft_consensus.cc:2243] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.762979 14089 raft_consensus.cc:2272] T 5a9feb07deb0485ca0233f18808edf06 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.764816 14089 tablet_replica.cc:333] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470: stopping tablet replica
W20260201 08:58:29.765182 14813 consensus_peers.cc:597] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 -> Peer 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637): Couldn't send request to peer 9d02cc37a80544249ab6060617f30a8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:42637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:29.765362 14089 raft_consensus.cc:2243] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.766186 14089 raft_consensus.cc:2272] T 32153f11aaef4157912baebcca102ccc P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.767841 14089 tablet_replica.cc:333] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.768321 14089 raft_consensus.cc:2243] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.768810 14089 raft_consensus.cc:2272] T d82268dbf5484caba89dc55f3761892c P baa9855381ce480a8590db2271c1b470 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.770489 14089 tablet_replica.cc:333] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.770929 14089 raft_consensus.cc:2243] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.771322 14089 raft_consensus.cc:2272] T f1265b5459a54ca6ba94cd958f4c60b5 P baa9855381ce480a8590db2271c1b470 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.772908 14089 tablet_replica.cc:333] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.773339 14089 raft_consensus.cc:2243] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.774097 14089 raft_consensus.cc:2272] T 3c73128561a046e6adcbc3ed387310e4 P baa9855381ce480a8590db2271c1b470 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.775650 14089 tablet_replica.cc:333] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470: stopping tablet replica
I20260201 08:58:29.776065 14089 raft_consensus.cc:2243] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.776466 14089 raft_consensus.cc:2272] T 39cb022e9f0a4f7689de3c5b3fa03eae P baa9855381ce480a8590db2271c1b470 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.805995 14089 tablet_server.cc:195] TabletServer@127.13.194.66:0 shutdown complete.
I20260201 08:58:29.824527 14089 tablet_server.cc:178] TabletServer@127.13.194.67:0 shutting down...
W20260201 08:58:29.842821 14887 consensus_peers.cc:597] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f -> Peer 9d02cc37a80544249ab6060617f30a8d (127.13.194.65:42637): Couldn't send request to peer 9d02cc37a80544249ab6060617f30a8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:42637: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:29.849553 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:58:29.850173 14089 tablet_replica.cc:333] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.850813 14089 raft_consensus.cc:2243] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.851599 14089 raft_consensus.cc:2272] T 4d38bfe89dbb4f92bb4d288968629f9f P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.853338 14089 tablet_replica.cc:333] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.853807 14089 raft_consensus.cc:2243] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.854235 14089 raft_consensus.cc:2272] T 892bd3aede9b45098921d309c961a816 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.855916 14089 tablet_replica.cc:333] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.856407 14089 raft_consensus.cc:2243] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.856841 14089 raft_consensus.cc:2272] T f1265b5459a54ca6ba94cd958f4c60b5 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.858470 14089 tablet_replica.cc:333] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.858955 14089 raft_consensus.cc:2243] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.859361 14089 raft_consensus.cc:2272] T 3c73128561a046e6adcbc3ed387310e4 P ae718f3470d54aaca7f5fb973000014f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.861016 14089 tablet_replica.cc:333] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.861519 14089 raft_consensus.cc:2243] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 6 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.862298 14089 raft_consensus.cc:2272] T 39cb022e9f0a4f7689de3c5b3fa03eae P ae718f3470d54aaca7f5fb973000014f [term 6 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.864284 14089 tablet_replica.cc:333] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.864749 14089 raft_consensus.cc:2243] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.865267 14089 raft_consensus.cc:2272] T 32153f11aaef4157912baebcca102ccc P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.866976 14089 tablet_replica.cc:333] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.867429 14089 raft_consensus.cc:2243] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.867828 14089 raft_consensus.cc:2272] T d82268dbf5484caba89dc55f3761892c P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.869633 14089 tablet_replica.cc:333] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.870146 14089 raft_consensus.cc:2243] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.870927 14089 raft_consensus.cc:2272] T 5a9feb07deb0485ca0233f18808edf06 P ae718f3470d54aaca7f5fb973000014f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.872552 14089 tablet_replica.cc:333] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.873027 14089 raft_consensus.cc:2243] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.873420 14089 raft_consensus.cc:2272] T 33cfe8c6817e4cc7a2bc0f6ab7504d60 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.874961 14089 tablet_replica.cc:333] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f: stopping tablet replica
I20260201 08:58:29.875352 14089 raft_consensus.cc:2243] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:29.875932 14089 raft_consensus.cc:2272] T b0db090127504a04ad96b6f631941983 P ae718f3470d54aaca7f5fb973000014f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.922869 14089 tablet_server.cc:195] TabletServer@127.13.194.67:0 shutdown complete.
I20260201 08:58:29.942485 14089 master.cc:561] Master@127.13.194.126:38295 shutting down...
I20260201 08:58:29.962152 14089 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:58:29.962738 14089 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:29.963068 14089 tablet_replica.cc:333] T 00000000000000000000000000000000 P ae7087d1391744a29e892122af325973: stopping tablet replica
I20260201 08:58:29.981215 14089 master.cc:583] Master@127.13.194.126:38295 shutdown complete.
9d02cc37a80544249ab6060617f30a8d 5
ae718f3470d54aaca7f5fb973000014f 1
baa9855381ce480a8590db2271c1b470 4
9d02cc37a80544249ab6060617f30a8d 3
ae718f3470d54aaca7f5fb973000014f 3
baa9855381ce480a8590db2271c1b470 4
9d02cc37a80544249ab6060617f30a8d 8
ae718f3470d54aaca7f5fb973000014f 1
baa9855381ce480a8590db2271c1b470 1
9d02cc37a80544249ab6060617f30a8d 3
ae718f3470d54aaca7f5fb973000014f 3
baa9855381ce480a8590db2271c1b470 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29798 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260201 08:58:30.017434 14089 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.194.126:35057
I20260201 08:58:30.018512 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:30.023552 15193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:30.023805 15194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:30.025996 14089 server_base.cc:1060] running on GCE node
W20260201 08:58:30.026434 15196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:30.027356 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:30.027542 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:30.027664 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936310027653 us; error 0 us; skew 500 ppm
I20260201 08:58:30.028118 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:30.030617 14089 webserver.cc:492] Webserver started at http://127.13.194.126:36549/ using document root <none> and password file <none>
I20260201 08:58:30.031041 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:30.031196 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:30.031401 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:30.032456 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/master-0-root/instance:
uuid: "60d2b65f2b454c4bbb436aad84330f2e"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.036458 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260201 08:58:30.039508 15201 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.040153 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:58:30.040402 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/master-0-root
uuid: "60d2b65f2b454c4bbb436aad84330f2e"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.040660 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:30.059209 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:30.060459 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:30.096647 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.126:35057
I20260201 08:58:30.096738 15252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.126:35057 every 8 connection(s)
I20260201 08:58:30.100306 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.109758 15253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e: Bootstrap starting.
I20260201 08:58:30.114235 15253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:30.118257 15253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e: No bootstrap required, opened a new log
I20260201 08:58:30.120231 15253 raft_consensus.cc:359] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d2b65f2b454c4bbb436aad84330f2e" member_type: VOTER }
I20260201 08:58:30.120623 15253 raft_consensus.cc:385] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:30.120797 15253 raft_consensus.cc:740] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d2b65f2b454c4bbb436aad84330f2e, State: Initialized, Role: FOLLOWER
I20260201 08:58:30.121286 15253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d2b65f2b454c4bbb436aad84330f2e" member_type: VOTER }
I20260201 08:58:30.121690 15253 raft_consensus.cc:399] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:58:30.121878 15253 raft_consensus.cc:493] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:58:30.122087 15253 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:30.126003 15253 raft_consensus.cc:515] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d2b65f2b454c4bbb436aad84330f2e" member_type: VOTER }
I20260201 08:58:30.126458 15253 leader_election.cc:304] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 60d2b65f2b454c4bbb436aad84330f2e; no voters:
I20260201 08:58:30.127475 15253 leader_election.cc:290] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:58:30.127848 15256 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:30.129102 15256 raft_consensus.cc:697] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 1 LEADER]: Becoming Leader. State: Replica: 60d2b65f2b454c4bbb436aad84330f2e, State: Running, Role: LEADER
I20260201 08:58:30.129771 15256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d2b65f2b454c4bbb436aad84330f2e" member_type: VOTER }
I20260201 08:58:30.130286 15253 sys_catalog.cc:565] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:58:30.134526 15258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 60d2b65f2b454c4bbb436aad84330f2e. Latest consensus state: current_term: 1 leader_uuid: "60d2b65f2b454c4bbb436aad84330f2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d2b65f2b454c4bbb436aad84330f2e" member_type: VOTER } }
I20260201 08:58:30.134619 15257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "60d2b65f2b454c4bbb436aad84330f2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "60d2b65f2b454c4bbb436aad84330f2e" member_type: VOTER } }
I20260201 08:58:30.135181 15258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [sys.catalog]: This master's current role is: LEADER
I20260201 08:58:30.135248 15257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [sys.catalog]: This master's current role is: LEADER
I20260201 08:58:30.137629 15264 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:58:30.142432 15264 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:58:30.145332 14089 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:58:30.150471 15264 catalog_manager.cc:1357] Generated new cluster ID: b9b8646e9d9f422db4270abba9abd356
I20260201 08:58:30.150779 15264 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:58:30.190958 15264 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:58:30.192160 15264 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:58:30.216312 15264 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e: Generated new TSK 0
I20260201 08:58:30.216936 15264 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:58:30.276393 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:30.282045 15274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:30.283236 15275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:30.285596 15277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:30.286360 14089 server_base.cc:1060] running on GCE node
I20260201 08:58:30.287168 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:30.287348 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:30.287479 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936310287467 us; error 0 us; skew 500 ppm
I20260201 08:58:30.287946 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:30.290143 14089 webserver.cc:492] Webserver started at http://127.13.194.65:46449/ using document root <none> and password file <none>
I20260201 08:58:30.290580 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:30.290728 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:30.290932 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:30.291981 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/instance:
uuid: "30f18d77acb94b73a5ef2abf32e480d3"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.296218 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260201 08:58:30.299322 15282 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.300001 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:58:30.300256 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
uuid: "30f18d77acb94b73a5ef2abf32e480d3"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.300522 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:30.326951 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:30.328223 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:30.329743 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:58:30.332103 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:58:30.332309 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.332527 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:58:30.332683 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.370319 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.65:41253
I20260201 08:58:30.370407 15344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.65:41253 every 8 connection(s)
I20260201 08:58:30.374845 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:30.381110 15349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:30.381704 15350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:30.385757 15352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:30.386842 14089 server_base.cc:1060] running on GCE node
I20260201 08:58:30.387102 15345 heartbeater.cc:344] Connected to a master server at 127.13.194.126:35057
I20260201 08:58:30.387455 15345 heartbeater.cc:461] Registering TS with master...
I20260201 08:58:30.387743 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:30.387953 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:30.388098 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936310388082 us; error 0 us; skew 500 ppm
I20260201 08:58:30.388113 15345 heartbeater.cc:507] Master 127.13.194.126:35057 requested a full tablet report, sending...
I20260201 08:58:30.388671 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:30.390334 15218 ts_manager.cc:194] Registered new tserver with Master: 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:30.391297 14089 webserver.cc:492] Webserver started at http://127.13.194.66:43319/ using document root <none> and password file <none>
I20260201 08:58:30.391932 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:30.392175 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:30.392470 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:30.392724 15218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35122
I20260201 08:58:30.393966 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/instance:
uuid: "544080112cc84e33ae3530baadd1d0dd"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.398211 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260201 08:58:30.401372 15357 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.402078 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260201 08:58:30.402364 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root
uuid: "544080112cc84e33ae3530baadd1d0dd"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.402621 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:30.423259 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:30.424495 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:30.425972 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:58:30.428196 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:58:30.428400 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.428645 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:58:30.428800 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.466476 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.66:45593
I20260201 08:58:30.466611 15419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.66:45593 every 8 connection(s)
I20260201 08:58:30.470872 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:30.477571 15423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:30.478322 15424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:30.479792 15426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:30.480597 14089 server_base.cc:1060] running on GCE node
I20260201 08:58:30.481547 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:30.481863 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:30.482084 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936310482064 us; error 0 us; skew 500 ppm
I20260201 08:58:30.482703 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:30.483152 15420 heartbeater.cc:344] Connected to a master server at 127.13.194.126:35057
I20260201 08:58:30.483505 15420 heartbeater.cc:461] Registering TS with master...
I20260201 08:58:30.484383 15420 heartbeater.cc:507] Master 127.13.194.126:35057 requested a full tablet report, sending...
I20260201 08:58:30.485276 14089 webserver.cc:492] Webserver started at http://127.13.194.67:35109/ using document root <none> and password file <none>
I20260201 08:58:30.485813 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:30.486035 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:30.486274 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:30.486428 15218 ts_manager.cc:194] Registered new tserver with Master: 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:30.487331 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/instance:
uuid: "e3f02001764a476e95c2584a094fa7d6"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.487762 15218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35130
I20260201 08:58:30.491833 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260201 08:58:30.495033 15431 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.495695 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260201 08:58:30.495973 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root
uuid: "e3f02001764a476e95c2584a094fa7d6"
format_stamp: "Formatted at 2026-02-01 08:58:30 on dist-test-slave-7fnp"
I20260201 08:58:30.496227 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:30.513242 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:30.514393 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:30.515765 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:58:30.517861 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:58:30.518066 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.518281 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:58:30.518427 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:30.555397 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.67:39459
I20260201 08:58:30.555485 15493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.67:39459 every 8 connection(s)
I20260201 08:58:30.567822 15494 heartbeater.cc:344] Connected to a master server at 127.13.194.126:35057
I20260201 08:58:30.568186 15494 heartbeater.cc:461] Registering TS with master...
I20260201 08:58:30.568876 15494 heartbeater.cc:507] Master 127.13.194.126:35057 requested a full tablet report, sending...
I20260201 08:58:30.570533 15218 ts_manager.cc:194] Registered new tserver with Master: e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:30.571478 14089 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013032628s
I20260201 08:58:30.571768 15218 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35142
I20260201 08:58:30.594305 15218 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35144:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 08:58:30.600255 15218 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 08:58:30.787071 15384 tablet_service.cc:1505] Processing CreateTablet for tablet f803005bcce24dbea779215746b9d2ca (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260201 08:58:30.787779 15385 tablet_service.cc:1505] Processing CreateTablet for tablet 10bddef534db4c1a811007e65a553a1c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260201 08:58:30.788529 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f803005bcce24dbea779215746b9d2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.789618 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bddef534db4c1a811007e65a553a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.790366 15383 tablet_service.cc:1505] Processing CreateTablet for tablet edba8ca9af3f45589c3bf2437e521a27 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260201 08:58:30.792150 15381 tablet_service.cc:1505] Processing CreateTablet for tablet 17706b520675450192459a881b96a1ce (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260201 08:58:30.794178 15382 tablet_service.cc:1505] Processing CreateTablet for tablet f5f5d6cd697b47e9902f4fc7e8b5f02d (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260201 08:58:30.795651 15380 tablet_service.cc:1505] Processing CreateTablet for tablet f8e27f1a110b46768ce90a7cf579c5c7 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260201 08:58:30.798704 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edba8ca9af3f45589c3bf2437e521a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.798799 15458 tablet_service.cc:1505] Processing CreateTablet for tablet f803005bcce24dbea779215746b9d2ca (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260201 08:58:30.799743 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e27f1a110b46768ce90a7cf579c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.800082 15458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f803005bcce24dbea779215746b9d2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.801419 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17706b520675450192459a881b96a1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.801970 15457 tablet_service.cc:1505] Processing CreateTablet for tablet edba8ca9af3f45589c3bf2437e521a27 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260201 08:58:30.804131 15456 tablet_service.cc:1505] Processing CreateTablet for tablet f5f5d6cd697b47e9902f4fc7e8b5f02d (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260201 08:58:30.804847 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f5d6cd697b47e9902f4fc7e8b5f02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.806310 15455 tablet_service.cc:1505] Processing CreateTablet for tablet 17706b520675450192459a881b96a1ce (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260201 08:58:30.808403 15454 tablet_service.cc:1505] Processing CreateTablet for tablet f8e27f1a110b46768ce90a7cf579c5c7 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260201 08:58:30.797165 15459 tablet_service.cc:1505] Processing CreateTablet for tablet 10bddef534db4c1a811007e65a553a1c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260201 08:58:30.797480 15379 tablet_service.cc:1505] Processing CreateTablet for tablet 3a58e5895d1541adabbfb02b14fa2735 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260201 08:58:30.810912 15379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a58e5895d1541adabbfb02b14fa2735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.812702 15453 tablet_service.cc:1505] Processing CreateTablet for tablet 3a58e5895d1541adabbfb02b14fa2735 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260201 08:58:30.821316 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17706b520675450192459a881b96a1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.823454 15453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a58e5895d1541adabbfb02b14fa2735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.824106 15457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edba8ca9af3f45589c3bf2437e521a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.826826 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bddef534db4c1a811007e65a553a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.829211 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f5d6cd697b47e9902f4fc7e8b5f02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.831842 15454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e27f1a110b46768ce90a7cf579c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.855988 15508 tablet_bootstrap.cc:492] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:30.857015 15383 tablet_service.cc:1505] Processing CreateTablet for tablet 3ab6f302faf345749d3ea009054209cb (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260201 08:58:30.858279 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab6f302faf345749d3ea009054209cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.863562 15508 tablet_bootstrap.cc:654] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:30.867748 15452 tablet_service.cc:1505] Processing CreateTablet for tablet 3ab6f302faf345749d3ea009054209cb (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260201 08:58:30.874239 15452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab6f302faf345749d3ea009054209cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.875092 15455 tablet_service.cc:1505] Processing CreateTablet for tablet 43ebb725235944919ca48499c364ba78 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260201 08:58:30.876336 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ebb725235944919ca48499c364ba78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.876375 15385 tablet_service.cc:1505] Processing CreateTablet for tablet 601eb231d2e943dcb0d893b620bbf937 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260201 08:58:30.877632 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601eb231d2e943dcb0d893b620bbf937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.872282 15382 tablet_service.cc:1505] Processing CreateTablet for tablet 43ebb725235944919ca48499c364ba78 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260201 08:58:30.884164 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ebb725235944919ca48499c364ba78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.890116 15451 tablet_service.cc:1505] Processing CreateTablet for tablet 601eb231d2e943dcb0d893b620bbf937 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260201 08:58:30.893242 15451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601eb231d2e943dcb0d893b620bbf937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.893977 15459 tablet_service.cc:1505] Processing CreateTablet for tablet 74dd5038caeb4002a7029db349d2d5ea (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260201 08:58:30.895174 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74dd5038caeb4002a7029db349d2d5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.890061 15381 tablet_service.cc:1505] Processing CreateTablet for tablet 74dd5038caeb4002a7029db349d2d5ea (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260201 08:58:30.901870 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74dd5038caeb4002a7029db349d2d5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.902479 15509 tablet_bootstrap.cc:492] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:30.906329 15384 tablet_service.cc:1505] Processing CreateTablet for tablet 6dd8fa6771ed43a38e4769a0d1863183 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260201 08:58:30.907594 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd8fa6771ed43a38e4769a0d1863183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.921339 15310 tablet_service.cc:1505] Processing CreateTablet for tablet 10bddef534db4c1a811007e65a553a1c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260201 08:58:30.922711 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10bddef534db4c1a811007e65a553a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.923833 15305 tablet_service.cc:1505] Processing CreateTablet for tablet f8e27f1a110b46768ce90a7cf579c5c7 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260201 08:58:30.925200 15305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e27f1a110b46768ce90a7cf579c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.926011 15309 tablet_service.cc:1505] Processing CreateTablet for tablet f803005bcce24dbea779215746b9d2ca (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260201 08:58:30.927760 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f803005bcce24dbea779215746b9d2ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.929934 15456 tablet_service.cc:1505] Processing CreateTablet for tablet 6dd8fa6771ed43a38e4769a0d1863183 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260201 08:58:30.931281 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd8fa6771ed43a38e4769a0d1863183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.931567 15380 tablet_service.cc:1505] Processing CreateTablet for tablet c37d9e5e810f4cde8bf85667cc298883 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260201 08:58:30.932824 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37d9e5e810f4cde8bf85667cc298883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.933040 15303 tablet_service.cc:1505] Processing CreateTablet for tablet 3ab6f302faf345749d3ea009054209cb (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260201 08:58:30.934317 15303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab6f302faf345749d3ea009054209cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.940907 15301 tablet_service.cc:1505] Processing CreateTablet for tablet 601eb231d2e943dcb0d893b620bbf937 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260201 08:58:30.942288 15301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601eb231d2e943dcb0d893b620bbf937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.946012 15307 tablet_service.cc:1505] Processing CreateTablet for tablet f5f5d6cd697b47e9902f4fc7e8b5f02d (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260201 08:58:30.947368 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f5d6cd697b47e9902f4fc7e8b5f02d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.922744 15306 tablet_service.cc:1505] Processing CreateTablet for tablet 17706b520675450192459a881b96a1ce (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260201 08:58:30.950325 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17706b520675450192459a881b96a1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.949970 15308 tablet_service.cc:1505] Processing CreateTablet for tablet edba8ca9af3f45589c3bf2437e521a27 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260201 08:58:30.951288 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edba8ca9af3f45589c3bf2437e521a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.958039 15378 tablet_service.cc:1505] Processing CreateTablet for tablet 8cce9e137d99477387581030f09ca781 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260201 08:58:30.959407 15378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cce9e137d99477387581030f09ca781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.960618 15376 tablet_service.cc:1505] Processing CreateTablet for tablet d06ae7b6994d4f5a99bb33b73a0719d0 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260201 08:58:30.961944 15376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06ae7b6994d4f5a99bb33b73a0719d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.961982 15377 tablet_service.cc:1505] Processing CreateTablet for tablet f5ecb583266e43b38c0deee2e253c52f (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260201 08:58:30.946008 15302 tablet_service.cc:1505] Processing CreateTablet for tablet 43ebb725235944919ca48499c364ba78 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260201 08:58:30.927069 15304 tablet_service.cc:1505] Processing CreateTablet for tablet 3a58e5895d1541adabbfb02b14fa2735 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260201 08:58:30.956717 15379 tablet_service.cc:1505] Processing CreateTablet for tablet bb8029b5e36242caa04004ece3d1bb98 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260201 08:58:30.965955 15379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8029b5e36242caa04004ece3d1bb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.965710 15384 tablet_service.cc:1505] Processing CreateTablet for tablet 3bc17c52abef44ba92ab2c0659577d3c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260201 08:58:30.966882 15458 tablet_service.cc:1505] Processing CreateTablet for tablet f5ecb583266e43b38c0deee2e253c52f (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260201 08:58:30.968129 15458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ecb583266e43b38c0deee2e253c52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.967857 15450 tablet_service.cc:1505] Processing CreateTablet for tablet d06ae7b6994d4f5a99bb33b73a0719d0 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260201 08:58:30.969492 15455 tablet_service.cc:1505] Processing CreateTablet for tablet 3bc17c52abef44ba92ab2c0659577d3c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260201 08:58:30.965842 15457 tablet_service.cc:1505] Processing CreateTablet for tablet 8cce9e137d99477387581030f09ca781 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260201 08:58:30.970438 15302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43ebb725235944919ca48499c364ba78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.970736 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc17c52abef44ba92ab2c0659577d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.971325 15457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cce9e137d99477387581030f09ca781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.971752 15304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a58e5895d1541adabbfb02b14fa2735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.972791 15450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06ae7b6994d4f5a99bb33b73a0719d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.966826 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc17c52abef44ba92ab2c0659577d3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.974417 15377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ecb583266e43b38c0deee2e253c52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.975186 15509 tablet_bootstrap.cc:654] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:30.986809 15383 tablet_service.cc:1505] Processing CreateTablet for tablet 1a6f3a1022c04fbea745045247de85a4 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260201 08:58:30.988093 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6f3a1022c04fbea745045247de85a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:30.990653 15453 tablet_service.cc:1505] Processing CreateTablet for tablet 1a6f3a1022c04fbea745045247de85a4 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260201 08:58:30.992010 15453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6f3a1022c04fbea745045247de85a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.004025 15309 tablet_service.cc:1505] Processing CreateTablet for tablet 74dd5038caeb4002a7029db349d2d5ea (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260201 08:58:31.012171 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74dd5038caeb4002a7029db349d2d5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.018092 15381 tablet_service.cc:1505] Processing CreateTablet for tablet bfdb7fc00ac24ebc843ae2a3fe089389 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260201 08:58:31.019830 15456 tablet_service.cc:1505] Processing CreateTablet for tablet bb8029b5e36242caa04004ece3d1bb98 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260201 08:58:31.021306 15303 tablet_service.cc:1505] Processing CreateTablet for tablet 6dd8fa6771ed43a38e4769a0d1863183 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260201 08:58:31.030273 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8029b5e36242caa04004ece3d1bb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.030195 15454 tablet_service.cc:1505] Processing CreateTablet for tablet c37d9e5e810f4cde8bf85667cc298883 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260201 08:58:31.033100 15454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37d9e5e810f4cde8bf85667cc298883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.034111 15508 tablet_bootstrap.cc:492] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:31.034566 15508 ts_tablet_manager.cc:1403] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.179s user 0.021s sys 0.018s
I20260201 08:58:31.025630 15305 tablet_service.cc:1505] Processing CreateTablet for tablet c37d9e5e810f4cde8bf85667cc298883 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260201 08:58:31.039633 15305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37d9e5e810f4cde8bf85667cc298883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.043241 15303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd8fa6771ed43a38e4769a0d1863183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.044366 15508 raft_consensus.cc:359] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.045243 15508 raft_consensus.cc:385] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.045589 15508 raft_consensus.cc:740] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.046502 15508 consensus_queue.cc:260] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.052534 15452 tablet_service.cc:1505] Processing CreateTablet for tablet bfdb7fc00ac24ebc843ae2a3fe089389 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260201 08:58:31.053622 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb7fc00ac24ebc843ae2a3fe089389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.053829 15452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb7fc00ac24ebc843ae2a3fe089389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.072081 15385 tablet_service.cc:1505] Processing CreateTablet for tablet 5ea6d15904e84f4db55e93adfea29377 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260201 08:58:31.077857 15512 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:31.083727 15512 tablet_bootstrap.cc:654] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.086105 15382 tablet_service.cc:1505] Processing CreateTablet for tablet 437ae8b0c2714e8985023ed0c9603d2a (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260201 08:58:31.090622 15509 tablet_bootstrap.cc:492] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:31.058436 15310 tablet_service.cc:1505] Processing CreateTablet for tablet bb8029b5e36242caa04004ece3d1bb98 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260201 08:58:31.094476 15509 ts_tablet_manager.cc:1403] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.193s user 0.008s sys 0.015s
I20260201 08:58:31.094887 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea6d15904e84f4db55e93adfea29377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.096184 15459 tablet_service.cc:1505] Processing CreateTablet for tablet 437ae8b0c2714e8985023ed0c9603d2a (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260201 08:58:31.097250 15509 raft_consensus.cc:359] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.097972 15509 raft_consensus.cc:385] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.098279 15509 raft_consensus.cc:740] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.098966 15509 consensus_queue.cc:260] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.099834 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437ae8b0c2714e8985023ed0c9603d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.102524 15301 tablet_service.cc:1505] Processing CreateTablet for tablet 3bc17c52abef44ba92ab2c0659577d3c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260201 08:58:31.086990 15308 tablet_service.cc:1505] Processing CreateTablet for tablet 8cce9e137d99477387581030f09ca781 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260201 08:58:31.107203 15378 tablet_service.cc:1505] Processing CreateTablet for tablet c2f539e5f0bc47eeb6b625d9cdfc7327 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260201 08:58:31.108556 15378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f539e5f0bc47eeb6b625d9cdfc7327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.111675 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cce9e137d99477387581030f09ca781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.112939 15302 tablet_service.cc:1505] Processing CreateTablet for tablet d06ae7b6994d4f5a99bb33b73a0719d0 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260201 08:58:31.114427 15302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06ae7b6994d4f5a99bb33b73a0719d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.119091 15307 tablet_service.cc:1505] Processing CreateTablet for tablet 1a6f3a1022c04fbea745045247de85a4 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260201 08:58:31.120363 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6f3a1022c04fbea745045247de85a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.121338 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb8029b5e36242caa04004ece3d1bb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.126490 15303 tablet_service.cc:1505] Processing CreateTablet for tablet bfdb7fc00ac24ebc843ae2a3fe089389 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260201 08:58:31.131022 15451 tablet_service.cc:1505] Processing CreateTablet for tablet 5ea6d15904e84f4db55e93adfea29377 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260201 08:58:31.132563 15451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea6d15904e84f4db55e93adfea29377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.129268 15301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bc17c52abef44ba92ab2c0659577d3c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:58:31.141319 15266 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:31.141988 15303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb7fc00ac24ebc843ae2a3fe089389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.146116 15384 tablet_service.cc:1505] Processing CreateTablet for tablet 86eab638067c49e79e1bdd4a3902cf7b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260201 08:58:31.151052 15420 heartbeater.cc:499] Master 127.13.194.126:35057 was elected leader, sending a full tablet report...
I20260201 08:58:31.158596 15494 heartbeater.cc:499] Master 127.13.194.126:35057 was elected leader, sending a full tablet report...
I20260201 08:58:31.161842 15508 ts_tablet_manager.cc:1434] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.127s user 0.010s sys 0.005s
I20260201 08:58:31.168144 15452 tablet_service.cc:1505] Processing CreateTablet for tablet c2f539e5f0bc47eeb6b625d9cdfc7327 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260201 08:58:31.169549 15452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f539e5f0bc47eeb6b625d9cdfc7327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.175524 15509 ts_tablet_manager.cc:1434] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.081s user 0.024s sys 0.037s
I20260201 08:58:31.176576 15509 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:31.180188 15304 tablet_service.cc:1505] Processing CreateTablet for tablet 5ea6d15904e84f4db55e93adfea29377 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260201 08:58:31.181222 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437ae8b0c2714e8985023ed0c9603d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.191322 15509 tablet_bootstrap.cc:654] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.196980 15304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea6d15904e84f4db55e93adfea29377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.217710 15306 tablet_service.cc:1505] Processing CreateTablet for tablet f5ecb583266e43b38c0deee2e253c52f (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260201 08:58:31.219113 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ecb583266e43b38c0deee2e253c52f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:58:31.220786 15421 tablet.cc:2378] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 08:58:31.223940 15455 tablet_service.cc:1505] Processing CreateTablet for tablet 86eab638067c49e79e1bdd4a3902cf7b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260201 08:58:31.224985 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86eab638067c49e79e1bdd4a3902cf7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.232523 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86eab638067c49e79e1bdd4a3902cf7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.236307 15508 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:31.247661 15378 tablet_service.cc:1505] Processing CreateTablet for tablet baa1e353775e4af5a659c0d25dc5d48b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260201 08:58:31.248307 15308 tablet_service.cc:1505] Processing CreateTablet for tablet 437ae8b0c2714e8985023ed0c9603d2a (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260201 08:58:31.249675 15378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa1e353775e4af5a659c0d25dc5d48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.253487 15509 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:31.255080 15509 ts_tablet_manager.cc:1403] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.079s user 0.025s sys 0.034s
I20260201 08:58:31.259518 15377 tablet_service.cc:1505] Processing CreateTablet for tablet a3cde26b6b4d4157a86e3c2b67ca2d72 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260201 08:58:31.260807 15377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cde26b6b4d4157a86e3c2b67ca2d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.262665 15509 raft_consensus.cc:359] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.263412 15509 raft_consensus.cc:385] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.263695 15509 raft_consensus.cc:740] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.265625 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437ae8b0c2714e8985023ed0c9603d2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.271045 15310 tablet_service.cc:1505] Processing CreateTablet for tablet c2f539e5f0bc47eeb6b625d9cdfc7327 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260201 08:58:31.273412 15512 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:31.285332 15512 ts_tablet_manager.cc:1403] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.208s user 0.024s sys 0.047s
I20260201 08:58:31.285763 15514 raft_consensus.cc:493] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:31.264386 15509 consensus_queue.cc:260] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.286235 15514 raft_consensus.cc:515] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.288008 15512 raft_consensus.cc:359] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.289593 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2f539e5f0bc47eeb6b625d9cdfc7327. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.290938 15513 raft_consensus.cc:493] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:31.291395 15513 raft_consensus.cc:515] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.278659 15309 tablet_service.cc:1505] Processing CreateTablet for tablet 86eab638067c49e79e1bdd4a3902cf7b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260201 08:58:31.289769 15307 tablet_service.cc:1505] Processing CreateTablet for tablet a3cde26b6b4d4157a86e3c2b67ca2d72 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260201 08:58:31.281687 15454 tablet_service.cc:1505] Processing CreateTablet for tablet baa1e353775e4af5a659c0d25dc5d48b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260201 08:58:31.284315 15508 tablet_bootstrap.cc:654] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.293645 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86eab638067c49e79e1bdd4a3902cf7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.280289 15305 tablet_service.cc:1505] Processing CreateTablet for tablet baa1e353775e4af5a659c0d25dc5d48b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260201 08:58:31.293797 15513 leader_election.cc:290] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:31.288703 15514 leader_election.cc:290] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:31.288733 15512 raft_consensus.cc:385] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.299646 15512 raft_consensus.cc:740] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.299899 15454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa1e353775e4af5a659c0d25dc5d48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.300333 15512 consensus_queue.cc:260] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.301126 15377 tablet_service.cc:1505] Processing CreateTablet for tablet 8085f989cb7c433b9306a89ddf9cf36b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260201 08:58:31.302557 15377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085f989cb7c433b9306a89ddf9cf36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.348673 15509 ts_tablet_manager.cc:1434] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.093s user 0.025s sys 0.011s
I20260201 08:58:31.356837 15383 tablet_service.cc:1505] Processing CreateTablet for tablet 72a1146f3e714f4c9b68d5f668ce839c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260201 08:58:31.358191 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a1146f3e714f4c9b68d5f668ce839c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.365010 15345 heartbeater.cc:499] Master 127.13.194.126:35057 was elected leader, sending a full tablet report...
I20260201 08:58:31.367170 15453 tablet_service.cc:1505] Processing CreateTablet for tablet a3cde26b6b4d4157a86e3c2b67ca2d72 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260201 08:58:31.368490 15453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cde26b6b4d4157a86e3c2b67ca2d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.369253 15305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa1e353775e4af5a659c0d25dc5d48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.373133 15512 ts_tablet_manager.cc:1434] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.087s user 0.024s sys 0.005s
I20260201 08:58:31.375185 15509 tablet_bootstrap.cc:492] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:31.373538 15459 tablet_service.cc:1505] Processing CreateTablet for tablet 8085f989cb7c433b9306a89ddf9cf36b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260201 08:58:31.378530 15376 tablet_service.cc:1505] Processing CreateTablet for tablet 6ddc7ec3a25a454b880657949ea0b9da (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260201 08:58:31.379070 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085f989cb7c433b9306a89ddf9cf36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.379751 15376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddc7ec3a25a454b880657949ea0b9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.382444 15380 tablet_service.cc:1505] Processing CreateTablet for tablet 4526578d0507494e9dd2e42783b20ab7 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260201 08:58:31.383667 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4526578d0507494e9dd2e42783b20ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.384770 15381 tablet_service.cc:1505] Processing CreateTablet for tablet e978370deeb04e9d85cf2cc3c936672b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260201 08:58:31.386000 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e978370deeb04e9d85cf2cc3c936672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.389406 15512 tablet_bootstrap.cc:492] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:31.389811 15379 tablet_service.cc:1505] Processing CreateTablet for tablet 6bd7a5722773409789e77823ae3e57e9 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260201 08:58:31.391026 15379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd7a5722773409789e77823ae3e57e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.407358 15301 tablet_service.cc:1505] Processing CreateTablet for tablet 8085f989cb7c433b9306a89ddf9cf36b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260201 08:58:31.410815 15303 tablet_service.cc:1505] Processing CreateTablet for tablet 72a1146f3e714f4c9b68d5f668ce839c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260201 08:58:31.412997 15385 tablet_service.cc:1505] Processing CreateTablet for tablet 9a39e92ebc0d4bc89814ec24579af33c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260201 08:58:31.413599 15456 tablet_service.cc:1505] Processing CreateTablet for tablet 72a1146f3e714f4c9b68d5f668ce839c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260201 08:58:31.414393 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39e92ebc0d4bc89814ec24579af33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.414763 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a1146f3e714f4c9b68d5f668ce839c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.420608 15509 tablet_bootstrap.cc:654] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.421134 15450 tablet_service.cc:1505] Processing CreateTablet for tablet 2706b5ec373d40a9bbf0d09ab72966d9 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260201 08:58:31.477334 15450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2706b5ec373d40a9bbf0d09ab72966d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.477411 15458 tablet_service.cc:1505] Processing CreateTablet for tablet 9a39e92ebc0d4bc89814ec24579af33c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260201 08:58:31.478678 15458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39e92ebc0d4bc89814ec24579af33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.423671 15305 tablet_service.cc:1505] Processing CreateTablet for tablet 6ddc7ec3a25a454b880657949ea0b9da (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260201 08:58:31.429796 15508 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:31.480746 15508 ts_tablet_manager.cc:1403] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.245s user 0.008s sys 0.012s
I20260201 08:58:31.483629 15508 raft_consensus.cc:359] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.484316 15508 raft_consensus.cc:385] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.484588 15508 raft_consensus.cc:740] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.435890 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edba8ca9af3f45589c3bf2437e521a27" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:31.485354 15380 tablet_service.cc:1505] Processing CreateTablet for tablet c11524c3a8704cfdba261441ff2bed79 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260201 08:58:31.486181 15435 leader_election.cc:343] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:31.486582 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11524c3a8704cfdba261441ff2bed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.437561 15382 tablet_service.cc:1505] Processing CreateTablet for tablet 2706b5ec373d40a9bbf0d09ab72966d9 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260201 08:58:31.487504 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2706b5ec373d40a9bbf0d09ab72966d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.446534 15457 tablet_service.cc:1505] Processing CreateTablet for tablet 4526578d0507494e9dd2e42783b20ab7 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260201 08:58:31.489583 15457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4526578d0507494e9dd2e42783b20ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.447387 15451 tablet_service.cc:1505] Processing CreateTablet for tablet e978370deeb04e9d85cf2cc3c936672b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260201 08:58:31.492673 15451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e978370deeb04e9d85cf2cc3c936672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.493570 15379 tablet_service.cc:1505] Processing CreateTablet for tablet 15ac6b4592d14c9085fa39e7b3613e9b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260201 08:58:31.494729 15379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ac6b4592d14c9085fa39e7b3613e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.447602 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edba8ca9af3f45589c3bf2437e521a27" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:31.450112 15452 tablet_service.cc:1505] Processing CreateTablet for tablet 6bd7a5722773409789e77823ae3e57e9 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260201 08:58:31.498119 15452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd7a5722773409789e77823ae3e57e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.501309 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:31.502429 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:31.504002 15385 tablet_service.cc:1505] Processing CreateTablet for tablet 522cf687b901401fbb953840208dd405 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260201 08:58:31.504384 15361 leader_election.cc:343] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:31.506353 15433 leader_election.cc:343] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:31.506875 15433 leader_election.cc:304] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:31.507799 15522 raft_consensus.cc:2749] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:58:31.508222 15361 leader_election.cc:343] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:31.508963 15361 leader_election.cc:304] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:31.510116 15513 raft_consensus.cc:2749] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:31.513300 15508 consensus_queue.cc:260] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.515666 15508 ts_tablet_manager.cc:1434] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260201 08:58:31.456743 15378 tablet_service.cc:1505] Processing CreateTablet for tablet 491c0efe7c624b5f98f4894361bf6e68 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260201 08:58:31.458079 15308 tablet_service.cc:1505] Processing CreateTablet for tablet e978370deeb04e9d85cf2cc3c936672b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260201 08:58:31.539337 15377 tablet_service.cc:1505] Processing CreateTablet for tablet 70006ed087454f3d92664b9822397752 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260201 08:58:31.461784 15455 tablet_service.cc:1505] Processing CreateTablet for tablet 6ddc7ec3a25a454b880657949ea0b9da (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260201 08:58:31.412686 15306 tablet_service.cc:1505] Processing CreateTablet for tablet 2706b5ec373d40a9bbf0d09ab72966d9 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260201 08:58:31.542112 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddc7ec3a25a454b880657949ea0b9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.545631 15381 tablet_service.cc:1505] Processing CreateTablet for tablet aff4e6978c594672a5ad5e2b9fe02d80 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260201 08:58:31.546092 15450 tablet_service.cc:1505] Processing CreateTablet for tablet 491c0efe7c624b5f98f4894361bf6e68 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260201 08:58:31.469694 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cde26b6b4d4157a86e3c2b67ca2d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.432624 15512 tablet_bootstrap.cc:654] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.520839 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522cf687b901401fbb953840208dd405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.547540 15376 tablet_service.cc:1505] Processing CreateTablet for tablet 46ee294a812241f3a8153b898b24e7c4 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260201 08:58:31.548702 15376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ee294a812241f3a8153b898b24e7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.553186 15377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70006ed087454f3d92664b9822397752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.555410 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2706b5ec373d40a9bbf0d09ab72966d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.524747 15509 tablet_bootstrap.cc:492] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:31.557157 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff4e6978c594672a5ad5e2b9fe02d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.557217 15509 ts_tablet_manager.cc:1403] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.182s user 0.020s sys 0.000s
I20260201 08:58:31.530656 15309 tablet_service.cc:1505] Processing CreateTablet for tablet 6bd7a5722773409789e77823ae3e57e9 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260201 08:58:31.559052 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd7a5722773409789e77823ae3e57e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.559226 15458 tablet_service.cc:1505] Processing CreateTablet for tablet 15ac6b4592d14c9085fa39e7b3613e9b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260201 08:58:31.452773 15304 tablet_service.cc:1505] Processing CreateTablet for tablet 4526578d0507494e9dd2e42783b20ab7 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260201 08:58:31.561357 15456 tablet_service.cc:1505] Processing CreateTablet for tablet c11524c3a8704cfdba261441ff2bed79 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260201 08:58:31.539659 15384 tablet_service.cc:1505] Processing CreateTablet for tablet 2914abdfc16e44c98c0e73c8c82e4c45 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260201 08:58:31.557057 15522 raft_consensus.cc:493] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:31.562526 15453 tablet_service.cc:1505] Processing CreateTablet for tablet 522cf687b901401fbb953840208dd405 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260201 08:58:31.562865 15522 raft_consensus.cc:515] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.563556 15459 tablet_service.cc:1505] Processing CreateTablet for tablet 70006ed087454f3d92664b9822397752 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260201 08:58:31.564041 15378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491c0efe7c624b5f98f4894361bf6e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.566128 15522 leader_election.cc:290] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:31.566313 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17706b520675450192459a881b96a1ce" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:31.567353 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2914abdfc16e44c98c0e73c8c82e4c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.566326 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17706b520675450192459a881b96a1ce" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:31.567574 15433 leader_election.cc:343] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:31.567880 15320 raft_consensus.cc:2468] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:31.569079 15435 leader_election.cc:304] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:31.569799 15509 raft_consensus.cc:359] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.570492 15509 raft_consensus.cc:385] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.570765 15509 raft_consensus.cc:740] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.571381 15450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491c0efe7c624b5f98f4894361bf6e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.571961 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11524c3a8704cfdba261441ff2bed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.572712 15522 raft_consensus.cc:2804] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:31.562551 15304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4526578d0507494e9dd2e42783b20ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.573094 15522 raft_consensus.cc:493] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:31.573534 15522 raft_consensus.cc:3060] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:31.574045 15458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ac6b4592d14c9085fa39e7b3613e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.583951 15454 tablet_service.cc:1505] Processing CreateTablet for tablet 2914abdfc16e44c98c0e73c8c82e4c45 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260201 08:58:31.577135 15305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddc7ec3a25a454b880657949ea0b9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.597187 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e978370deeb04e9d85cf2cc3c936672b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.582468 15302 tablet_service.cc:1505] Processing CreateTablet for tablet 491c0efe7c624b5f98f4894361bf6e68 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260201 08:58:31.599287 15302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491c0efe7c624b5f98f4894361bf6e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.576181 15509 consensus_queue.cc:260] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.601599 15303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a1146f3e714f4c9b68d5f668ce839c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.605674 15509 ts_tablet_manager.cc:1434] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.048s user 0.007s sys 0.001s
I20260201 08:58:31.530840 15310 tablet_service.cc:1505] Processing CreateTablet for tablet 9a39e92ebc0d4bc89814ec24579af33c (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260201 08:58:31.609630 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39e92ebc0d4bc89814ec24579af33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.612675 15508 tablet_bootstrap.cc:492] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:31.617270 15509 tablet_bootstrap.cc:492] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:31.584622 15385 tablet_service.cc:1505] Processing CreateTablet for tablet 701bd49fcb3346a0873fe568317002e8 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260201 08:58:31.618986 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701bd49fcb3346a0873fe568317002e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.576074 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70006ed087454f3d92664b9822397752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.621573 15453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522cf687b901401fbb953840208dd405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.624223 15454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2914abdfc16e44c98c0e73c8c82e4c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.627580 15509 tablet_bootstrap.cc:654] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.629520 15301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085f989cb7c433b9306a89ddf9cf36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.661876 15451 tablet_service.cc:1505] Processing CreateTablet for tablet c3675b3fa6c6432984d1f5cfd34fd873 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260201 08:58:31.663147 15451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3675b3fa6c6432984d1f5cfd34fd873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.665182 15512 tablet_bootstrap.cc:492] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:31.665660 15512 ts_tablet_manager.cc:1403] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.276s user 0.011s sys 0.012s
I20260201 08:58:31.652729 15382 tablet_service.cc:1505] Processing CreateTablet for tablet c3675b3fa6c6432984d1f5cfd34fd873 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260201 08:58:31.668295 15512 raft_consensus.cc:359] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.673352 15305 tablet_service.cc:1505] Processing CreateTablet for tablet 2914abdfc16e44c98c0e73c8c82e4c45 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260201 08:58:31.682250 15305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2914abdfc16e44c98c0e73c8c82e4c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.683856 15304 tablet_service.cc:1505] Processing CreateTablet for tablet 522cf687b901401fbb953840208dd405 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260201 08:58:31.685094 15304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522cf687b901401fbb953840208dd405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.687487 15302 tablet_service.cc:1505] Processing CreateTablet for tablet 70006ed087454f3d92664b9822397752 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260201 08:58:31.688812 15302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70006ed087454f3d92664b9822397752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.634058 15458 tablet_service.cc:1505] Processing CreateTablet for tablet 46ee294a812241f3a8153b898b24e7c4 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260201 08:58:31.692461 15458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ee294a812241f3a8153b898b24e7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.673821 15512 raft_consensus.cc:385] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.693176 15512 raft_consensus.cc:740] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.693926 15512 consensus_queue.cc:260] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.697954 15383 tablet_service.cc:1505] Processing CreateTablet for tablet de818d695150438d84ff5feff7a448c6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260201 08:58:31.698637 15512 ts_tablet_manager.cc:1434] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.033s user 0.007s sys 0.000s
I20260201 08:58:31.698758 15455 tablet_service.cc:1505] Processing CreateTablet for tablet e2a071c31ac54253b3abf1a4dd962735 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260201 08:58:31.699738 15512 tablet_bootstrap.cc:492] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:31.679369 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3675b3fa6c6432984d1f5cfd34fd873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.676543 15384 tablet_service.cc:1505] Processing CreateTablet for tablet bc5ab607d0114b979fafd03b2cd64b82 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260201 08:58:31.702183 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5ab607d0114b979fafd03b2cd64b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.702704 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de818d695150438d84ff5feff7a448c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.632160 15452 tablet_service.cc:1505] Processing CreateTablet for tablet 701bd49fcb3346a0873fe568317002e8 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260201 08:58:31.648012 15522 raft_consensus.cc:515] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.655246 15380 tablet_service.cc:1505] Processing CreateTablet for tablet e2a071c31ac54253b3abf1a4dd962735 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260201 08:58:31.710188 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a071c31ac54253b3abf1a4dd962735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.711180 15522 leader_election.cc:290] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:31.711437 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17706b520675450192459a881b96a1ce" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:31.711967 15320 raft_consensus.cc:3060] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:31.656983 15308 tablet_service.cc:1505] Processing CreateTablet for tablet c11524c3a8704cfdba261441ff2bed79 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260201 08:58:31.717576 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11524c3a8704cfdba261441ff2bed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.717960 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17706b520675450192459a881b96a1ce" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
W20260201 08:58:31.719219 15433 leader_election.cc:343] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:31.721132 15320 raft_consensus.cc:2468] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:31.722232 15435 leader_election.cc:304] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:31.723306 15522 raft_consensus.cc:2804] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:31.723769 15522 raft_consensus.cc:697] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:31.724521 15522 consensus_queue.cc:237] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.725268 15450 tablet_service.cc:1505] Processing CreateTablet for tablet bc5ab607d0114b979fafd03b2cd64b82 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260201 08:58:31.658068 15306 tablet_service.cc:1505] Processing CreateTablet for tablet 15ac6b4592d14c9085fa39e7b3613e9b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260201 08:58:31.731680 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ac6b4592d14c9085fa39e7b3613e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.733004 15309 tablet_service.cc:1505] Processing CreateTablet for tablet aff4e6978c594672a5ad5e2b9fe02d80 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260201 08:58:31.734237 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff4e6978c594672a5ad5e2b9fe02d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.734346 15509 tablet_bootstrap.cc:492] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:31.734822 15509 ts_tablet_manager.cc:1403] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.002s
I20260201 08:58:31.630420 15457 tablet_service.cc:1505] Processing CreateTablet for tablet aff4e6978c594672a5ad5e2b9fe02d80 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260201 08:58:31.746817 15218 catalog_manager.cc:5654] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:31.727196 15459 tablet_service.cc:1505] Processing CreateTablet for tablet de818d695150438d84ff5feff7a448c6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260201 08:58:31.657686 15508 tablet_bootstrap.cc:654] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.699959 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a071c31ac54253b3abf1a4dd962735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.769654 15452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701bd49fcb3346a0873fe568317002e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.788461 15303 tablet_service.cc:1505] Processing CreateTablet for tablet c3675b3fa6c6432984d1f5cfd34fd873 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260201 08:58:31.789791 15303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3675b3fa6c6432984d1f5cfd34fd873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.789932 15384 tablet_service.cc:1505] Processing CreateTablet for tablet 243f1be44dc24698bb4e8556f40e21d3 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260201 08:58:31.791215 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243f1be44dc24698bb4e8556f40e21d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.765775 15509 raft_consensus.cc:359] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.798192 15509 raft_consensus.cc:385] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.798485 15509 raft_consensus.cc:740] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:31.799140 15509 consensus_queue.cc:260] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.805697 15521 raft_consensus.cc:493] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:31.806216 15521 raft_consensus.cc:515] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.808786 15521 leader_election.cc:290] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:31.809087 15457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff4e6978c594672a5ad5e2b9fe02d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.792390 15310 tablet_service.cc:1505] Processing CreateTablet for tablet e2a071c31ac54253b3abf1a4dd962735 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260201 08:58:31.821547 15453 tablet_service.cc:1505] Processing CreateTablet for tablet 243f1be44dc24698bb4e8556f40e21d3 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260201 08:58:31.823150 15301 tablet_service.cc:1505] Processing CreateTablet for tablet 701bd49fcb3346a0873fe568317002e8 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260201 08:58:31.801455 15509 ts_tablet_manager.cc:1434] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.066s user 0.007s sys 0.001s
I20260201 08:58:31.832190 15378 tablet_service.cc:1505] Processing CreateTablet for tablet 9202773444f2496c9bbc700a0b3a85f6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260201 08:58:31.833528 15378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9202773444f2496c9bbc700a0b3a85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.828833 15306 tablet_service.cc:1505] Processing CreateTablet for tablet bc5ab607d0114b979fafd03b2cd64b82 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260201 08:58:31.842154 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5ab607d0114b979fafd03b2cd64b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.842674 15307 tablet_service.cc:1505] Processing CreateTablet for tablet 46ee294a812241f3a8153b898b24e7c4 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260201 08:58:31.843915 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46ee294a812241f3a8153b898b24e7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.847961 15512 tablet_bootstrap.cc:654] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.856598 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2a071c31ac54253b3abf1a4dd962735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.860551 15456 tablet_service.cc:1505] Processing CreateTablet for tablet 9202773444f2496c9bbc700a0b3a85f6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260201 08:58:31.863309 15383 tablet_service.cc:1505] Processing CreateTablet for tablet 0e64d88347b44f8e8c8f0aa30d129641 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260201 08:58:31.864574 15450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5ab607d0114b979fafd03b2cd64b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.864796 15454 tablet_service.cc:1505] Processing CreateTablet for tablet 0e64d88347b44f8e8c8f0aa30d129641 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260201 08:58:31.866039 15454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e64d88347b44f8e8c8f0aa30d129641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.864717 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e64d88347b44f8e8c8f0aa30d129641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.869282 15301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701bd49fcb3346a0873fe568317002e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.872808 15522 raft_consensus.cc:493] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:31.873556 15453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243f1be44dc24698bb4e8556f40e21d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.873301 15522 raft_consensus.cc:515] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.875202 15522 leader_election.cc:290] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:31.875986 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:31.876621 15395 raft_consensus.cc:2468] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:31.877691 15509 tablet_bootstrap.cc:492] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:31.877791 15433 leader_election.cc:304] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:31.878628 15522 raft_consensus.cc:2804] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:31.878981 15522 raft_consensus.cc:493] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:31.879313 15522 raft_consensus.cc:3060] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:31.899758 15450 tablet_service.cc:1505] Processing CreateTablet for tablet 3165dd57af4a455d83facbd02fcb4b80 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260201 08:58:31.906960 15384 tablet_service.cc:1505] Processing CreateTablet for tablet 3165dd57af4a455d83facbd02fcb4b80 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260201 08:58:31.909615 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3165dd57af4a455d83facbd02fcb4b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.894495 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de818d695150438d84ff5feff7a448c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.912667 15514 raft_consensus.cc:493] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:31.913112 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9202773444f2496c9bbc700a0b3a85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.913172 15514 raft_consensus.cc:515] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.915175 15514 leader_election.cc:290] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:31.917033 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:31.917394 15308 tablet_service.cc:1505] Processing CreateTablet for tablet 243f1be44dc24698bb4e8556f40e21d3 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260201 08:58:31.918397 15433 leader_election.cc:343] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:31.918596 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 243f1be44dc24698bb4e8556f40e21d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.926667 15382 tablet_service.cc:1505] Processing CreateTablet for tablet 8ad471d716964e0ca752941d6b983477 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260201 08:58:31.927166 15451 tablet_service.cc:1505] Processing CreateTablet for tablet 8ad471d716964e0ca752941d6b983477 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260201 08:58:31.928002 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad471d716964e0ca752941d6b983477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.930063 15385 tablet_service.cc:1505] Processing CreateTablet for tablet 611e2cdf949d4159bce7bcd1606d9604 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260201 08:58:31.934060 15458 tablet_service.cc:1505] Processing CreateTablet for tablet 611e2cdf949d4159bce7bcd1606d9604 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260201 08:58:31.936458 15304 tablet_service.cc:1505] Processing CreateTablet for tablet 9202773444f2496c9bbc700a0b3a85f6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260201 08:58:31.937242 15377 tablet_service.cc:1505] Processing CreateTablet for tablet e55acce968e24f25b46b388a4fc2c773 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260201 08:58:31.939862 15509 tablet_bootstrap.cc:654] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:31.922164 15450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3165dd57af4a455d83facbd02fcb4b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.945158 15380 tablet_service.cc:1505] Processing CreateTablet for tablet 10d6363b9945401d80e4d6901e403c1b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260201 08:58:31.937728 15304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9202773444f2496c9bbc700a0b3a85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.961246 15458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611e2cdf949d4159bce7bcd1606d9604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.965692 15379 tablet_service.cc:1505] Processing CreateTablet for tablet 7ad26ab3f81f457890e164908be52f74 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260201 08:58:31.969170 15381 tablet_service.cc:1505] Processing CreateTablet for tablet 770d2fda022243328e17c46e34e5f4b5 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260201 08:58:31.979564 15451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad471d716964e0ca752941d6b983477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.980784 15508 tablet_bootstrap.cc:492] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:31.981297 15508 ts_tablet_manager.cc:1403] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.369s user 0.046s sys 0.051s
I20260201 08:58:31.983907 15508 raft_consensus.cc:359] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.984573 15508 raft_consensus.cc:385] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:31.985258 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:31.985545 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:31.998123 15319 raft_consensus.cc:2468] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:31.986830 15513 raft_consensus.cc:493] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:31.999358 15513 raft_consensus.cc:515] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:31.984836 15508 raft_consensus.cc:740] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.001240 15513 leader_election.cc:290] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:31.985610 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611e2cdf949d4159bce7bcd1606d9604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:31.991847 15522 raft_consensus.cc:515] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.004144 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.005172 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d6363b9945401d80e4d6901e403c1b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:58:32.005650 15361 leader_election.cc:343] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.005743 15522 leader_election.cc:290] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:31.990270 15455 tablet_service.cc:1505] Processing CreateTablet for tablet e55acce968e24f25b46b388a4fc2c773 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260201 08:58:32.006544 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.007428 15455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55acce968e24f25b46b388a4fc2c773. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:58:32.007895 15361 leader_election.cc:343] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.008298 15361 leader_election.cc:304] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:32.008780 15306 tablet_service.cc:1505] Processing CreateTablet for tablet 0e64d88347b44f8e8c8f0aa30d129641 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260201 08:58:32.009542 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770d2fda022243328e17c46e34e5f4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.009464 15513 raft_consensus.cc:2749] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:32.010022 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e64d88347b44f8e8c8f0aa30d129641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.011354 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.011921 15395 raft_consensus.cc:3060] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.011570 15377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55acce968e24f25b46b388a4fc2c773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.025066 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
W20260201 08:58:32.027966 15435 leader_election.cc:343] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.030650 15435 leader_election.cc:304] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:32.031435 15522 raft_consensus.cc:2804] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260201 08:58:32.031740 15435 leader_election.cc:343] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.031611 15384 tablet_service.cc:1505] Processing CreateTablet for tablet d83cd76a3c124667a5c4e76abfdcb0e6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260201 08:58:31.990733 15450 tablet_service.cc:1505] Processing CreateTablet for tablet 10d6363b9945401d80e4d6901e403c1b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260201 08:58:32.033080 15379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad26ab3f81f457890e164908be52f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.035097 15454 tablet_service.cc:1505] Processing CreateTablet for tablet 7ad26ab3f81f457890e164908be52f74 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260201 08:58:32.036374 15454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad26ab3f81f457890e164908be52f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.037472 15450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d6363b9945401d80e4d6901e403c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.001263 15508 consensus_queue.cc:260] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.044879 15508 ts_tablet_manager.cc:1434] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.063s user 0.002s sys 0.004s
I20260201 08:58:32.045449 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83cd76a3c124667a5c4e76abfdcb0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.045938 15508 tablet_bootstrap.cc:492] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.047076 15522 raft_consensus.cc:493] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.047478 15522 raft_consensus.cc:3060] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:31.993357 15305 tablet_service.cc:1505] Processing CreateTablet for tablet de818d695150438d84ff5feff7a448c6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260201 08:58:32.061503 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.062134 15395 raft_consensus.cc:2468] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.063081 15433 leader_election.cc:304] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
W20260201 08:58:32.063138 15284 leader_election.cc:343] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.065261 15514 raft_consensus.cc:2804] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.064301 15512 tablet_bootstrap.cc:492] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.068392 15307 tablet_service.cc:1505] Processing CreateTablet for tablet 3165dd57af4a455d83facbd02fcb4b80 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260201 08:58:32.069417 15512 ts_tablet_manager.cc:1403] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.370s user 0.009s sys 0.027s
I20260201 08:58:32.072021 15303 tablet_service.cc:1505] Processing CreateTablet for tablet 8ad471d716964e0ca752941d6b983477 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260201 08:58:31.994165 15457 tablet_service.cc:1505] Processing CreateTablet for tablet 770d2fda022243328e17c46e34e5f4b5 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260201 08:58:32.075527 15302 tablet_service.cc:1505] Processing CreateTablet for tablet 611e2cdf949d4159bce7bcd1606d9604 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260201 08:58:32.076113 15457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770d2fda022243328e17c46e34e5f4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.076725 15512 raft_consensus.cc:359] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.081866 15305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de818d695150438d84ff5feff7a448c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.083282 15456 tablet_service.cc:1505] Processing CreateTablet for tablet d83cd76a3c124667a5c4e76abfdcb0e6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260201 08:58:32.084482 15456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83cd76a3c124667a5c4e76abfdcb0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.094717 15310 tablet_service.cc:1505] Processing CreateTablet for tablet e55acce968e24f25b46b388a4fc2c773 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260201 08:58:32.110267 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.087641 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3165dd57af4a455d83facbd02fcb4b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.111498 15384 tablet_service.cc:1505] Processing CreateTablet for tablet 11b460db7c0c4e2a8c257d149e4d4111 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260201 08:58:32.112685 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b460db7c0c4e2a8c257d149e4d4111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.114588 15309 tablet_service.cc:1505] Processing CreateTablet for tablet 10d6363b9945401d80e4d6901e403c1b (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260201 08:58:32.115943 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d6363b9945401d80e4d6901e403c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.117146 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55acce968e24f25b46b388a4fc2c773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.121148 15303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad471d716964e0ca752941d6b983477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.122582 15301 tablet_service.cc:1505] Processing CreateTablet for tablet 770d2fda022243328e17c46e34e5f4b5 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260201 08:58:32.123941 15301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770d2fda022243328e17c46e34e5f4b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.126345 15302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611e2cdf949d4159bce7bcd1606d9604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.128326 15522 raft_consensus.cc:515] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.129580 15469 raft_consensus.cc:2393] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:32.133133 15286 leader_election.cc:304] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:32.133952 15521 raft_consensus.cc:3060] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.135725 15522 leader_election.cc:290] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.136078 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.136703 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
W20260201 08:58:32.137920 15433 leader_election.cc:343] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.086115 15512 raft_consensus.cc:385] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.141058 15512 raft_consensus.cc:740] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.141997 15512 consensus_queue.cc:260] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:32.143543 15266 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:32.143540 15521 raft_consensus.cc:2749] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:32.133836 15509 tablet_bootstrap.cc:492] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.147001 15509 ts_tablet_manager.cc:1403] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.270s user 0.014s sys 0.011s
I20260201 08:58:32.149737 15509 raft_consensus.cc:359] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.150425 15509 raft_consensus.cc:385] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.150703 15509 raft_consensus.cc:740] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.151381 15319 raft_consensus.cc:2468] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.153362 15435 leader_election.cc:304] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:32.156147 15459 tablet_service.cc:1505] Processing CreateTablet for tablet 11b460db7c0c4e2a8c257d149e4d4111 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260201 08:58:32.157395 15459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b460db7c0c4e2a8c257d149e4d4111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.161222 15522 raft_consensus.cc:2804] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.161701 15522 raft_consensus.cc:697] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.194350 15508 tablet_bootstrap.cc:654] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.163084 15514 raft_consensus.cc:697] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.201109 15512 ts_tablet_manager.cc:1434] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.131s user 0.021s sys 0.020s
W20260201 08:58:32.205430 15433 consensus_peers.cc:597] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:32.206315 15304 tablet_service.cc:1505] Processing CreateTablet for tablet d83cd76a3c124667a5c4e76abfdcb0e6 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260201 08:58:32.207556 15304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83cd76a3c124667a5c4e76abfdcb0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.209354 15512 tablet_bootstrap.cc:492] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.211802 15307 tablet_service.cc:1505] Processing CreateTablet for tablet 11b460db7c0c4e2a8c257d149e4d4111 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260201 08:58:32.192564 15306 tablet_service.cc:1505] Processing CreateTablet for tablet 7ad26ab3f81f457890e164908be52f74 (DEFAULT_TABLE table=test-workload [id=c68ca87543e24ad59eb44829721c21b6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260201 08:58:32.162487 15522 consensus_queue.cc:237] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.215440 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b460db7c0c4e2a8c257d149e4d4111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.216053 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad26ab3f81f457890e164908be52f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:32.216922 15512 tablet_bootstrap.cc:654] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.169700 15509 consensus_queue.cc:260] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.255350 15509 ts_tablet_manager.cc:1434] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.108s user 0.004s sys 0.002s
I20260201 08:58:32.266386 15537 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:32.270011 15509 tablet_bootstrap.cc:492] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.283228 15514 consensus_queue.cc:237] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.291930 15508 tablet_bootstrap.cc:492] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.292459 15508 ts_tablet_manager.cc:1403] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.247s user 0.012s sys 0.040s
I20260201 08:58:32.299988 15509 tablet_bootstrap.cc:654] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.319063 15508 raft_consensus.cc:359] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.319893 15508 raft_consensus.cc:385] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.320189 15508 raft_consensus.cc:740] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.321063 15522 raft_consensus.cc:493] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.321543 15522 raft_consensus.cc:515] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.323452 15522 leader_election.cc:290] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.324796 15508 consensus_queue.cc:260] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.328601 15508 ts_tablet_manager.cc:1434] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.036s user 0.006s sys 0.002s
I20260201 08:58:32.329619 15508 tablet_bootstrap.cc:492] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.337680 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.338490 15395 raft_consensus.cc:2468] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:32.338819 15508 tablet_bootstrap.cc:654] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.339815 15433 leader_election.cc:304] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:32.340793 15537 raft_consensus.cc:2804] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.341209 15537 raft_consensus.cc:493] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.341542 15537 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.348817 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:32.350147 15435 leader_election.cc:343] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.354857 15537 raft_consensus.cc:515] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.357547 15512 tablet_bootstrap.cc:492] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.358078 15512 ts_tablet_manager.cc:1403] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.149s user 0.010s sys 0.019s
I20260201 08:58:32.359786 15509 tablet_bootstrap.cc:492] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.362916 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.364367 15537 leader_election.cc:290] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.364596 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.364820 15508 tablet_bootstrap.cc:492] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.367405 15395 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.367573 15508 ts_tablet_manager.cc:1403] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.038s user 0.011s sys 0.008s
I20260201 08:58:32.367568 15509 ts_tablet_manager.cc:1403] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.098s user 0.025s sys 0.028s
I20260201 08:58:32.370496 15508 raft_consensus.cc:359] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.371001 15508 raft_consensus.cc:385] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.364914 15217 catalog_manager.cc:5654] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
W20260201 08:58:32.367528 15435 leader_election.cc:343] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.371308 15508 raft_consensus.cc:740] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.371074 15509 raft_consensus.cc:359] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.371806 15509 raft_consensus.cc:385] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.372079 15509 raft_consensus.cc:740] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.372821 15509 consensus_queue.cc:260] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.373124 15217 catalog_manager.cc:5654] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:32.374588 15395 raft_consensus.cc:2468] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.375046 15509 ts_tablet_manager.cc:1434] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20260201 08:58:32.372014 15508 consensus_queue.cc:260] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.375959 15509 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.375805 15433 leader_election.cc:304] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:32.377172 15537 raft_consensus.cc:2804] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.377624 15537 raft_consensus.cc:697] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.365069 15512 raft_consensus.cc:359] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.378285 15512 raft_consensus.cc:385] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.378397 15537 consensus_queue.cc:237] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.378993 15512 raft_consensus.cc:740] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.380450 15512 consensus_queue.cc:260] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.382472 15509 tablet_bootstrap.cc:654] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.381958 15508 ts_tablet_manager.cc:1434] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.014s user 0.004s sys 0.001s
I20260201 08:58:32.384482 15508 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.389029 15512 ts_tablet_manager.cc:1434] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.031s user 0.008s sys 0.000s
I20260201 08:58:32.391283 15508 tablet_bootstrap.cc:654] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.391635 15512 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.399705 15512 tablet_bootstrap.cc:654] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.415377 15512 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.415899 15512 ts_tablet_manager.cc:1403] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.003s
I20260201 08:58:32.418563 15512 raft_consensus.cc:359] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.419260 15512 raft_consensus.cc:385] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.419550 15512 raft_consensus.cc:740] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.420358 15512 consensus_queue.cc:260] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.423465 15216 catalog_manager.cc:5654] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:32.429774 15512 ts_tablet_manager.cc:1434] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.014s user 0.008s sys 0.000s
I20260201 08:58:32.435844 15512 tablet_bootstrap.cc:492] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.441797 15509 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.442468 15509 ts_tablet_manager.cc:1403] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.067s user 0.043s sys 0.012s
I20260201 08:58:32.442436 15512 tablet_bootstrap.cc:654] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.444837 15508 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.445328 15508 ts_tablet_manager.cc:1403] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.061s user 0.029s sys 0.030s
I20260201 08:58:32.445152 15509 raft_consensus.cc:359] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.445850 15509 raft_consensus.cc:385] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.446177 15509 raft_consensus.cc:740] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.446884 15509 consensus_queue.cc:260] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.447481 15512 tablet_bootstrap.cc:492] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.447911 15512 ts_tablet_manager.cc:1403] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260201 08:58:32.447983 15508 raft_consensus.cc:359] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.448700 15508 raft_consensus.cc:385] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.449012 15508 raft_consensus.cc:740] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.449227 15509 ts_tablet_manager.cc:1434] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260201 08:58:32.449770 15508 consensus_queue.cc:260] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.450331 15512 raft_consensus.cc:359] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.450968 15512 raft_consensus.cc:385] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.451238 15512 raft_consensus.cc:740] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.452071 15508 ts_tablet_manager.cc:1434] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:32.452440 15509 tablet_bootstrap.cc:492] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.451942 15512 consensus_queue.cc:260] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.453404 15508 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.458835 15509 tablet_bootstrap.cc:654] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.459586 15508 tablet_bootstrap.cc:654] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.460464 15512 ts_tablet_manager.cc:1434] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260201 08:58:32.468137 15508 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.468694 15508 ts_tablet_manager.cc:1403] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260201 08:58:32.468746 15512 tablet_bootstrap.cc:492] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.471611 15509 tablet_bootstrap.cc:492] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.472129 15509 ts_tablet_manager.cc:1403] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.010s
I20260201 08:58:32.472785 15508 raft_consensus.cc:359] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.473536 15508 raft_consensus.cc:385] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.473835 15508 raft_consensus.cc:740] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.474879 15512 tablet_bootstrap.cc:654] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.474583 15509 raft_consensus.cc:359] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.474610 15508 consensus_queue.cc:260] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.475332 15509 raft_consensus.cc:385] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.475607 15509 raft_consensus.cc:740] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.476323 15509 consensus_queue.cc:260] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.477350 15508 ts_tablet_manager.cc:1434] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260201 08:58:32.478276 15508 tablet_bootstrap.cc:492] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.478505 15509 ts_tablet_manager.cc:1434] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:58:32.481146 15509 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.484191 15508 tablet_bootstrap.cc:654] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.484722 15513 raft_consensus.cc:493] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.484987 15537 raft_consensus.cc:493] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.485211 15513 raft_consensus.cc:515] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.485523 15537 raft_consensus.cc:515] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.486379 15509 tablet_bootstrap.cc:654] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.487352 15513 leader_election.cc:290] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.489156 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edba8ca9af3f45589c3bf2437e521a27" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.489758 15319 raft_consensus.cc:2468] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:32.492220 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edba8ca9af3f45589c3bf2437e521a27" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.492944 15469 raft_consensus.cc:2468] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:32.494125 15512 tablet_bootstrap.cc:492] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.494661 15512 ts_tablet_manager.cc:1403] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.027s user 0.019s sys 0.002s
I20260201 08:58:32.494516 15361 leader_election.cc:304] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:32.495972 15513 raft_consensus.cc:2804] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.496399 15513 raft_consensus.cc:493] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.496779 15513 raft_consensus.cc:3060] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.497383 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8e27f1a110b46768ce90a7cf579c5c7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.498526 15319 raft_consensus.cc:2468] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:32.495851 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8e27f1a110b46768ce90a7cf579c5c7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.499696 15395 raft_consensus.cc:2468] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:32.500813 15433 leader_election.cc:304] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:32.501757 15550 raft_consensus.cc:2804] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.494628 15537 leader_election.cc:290] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.502192 15550 raft_consensus.cc:493] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.502566 15550 raft_consensus.cc:3060] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.505725 15512 raft_consensus.cc:359] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.506554 15512 raft_consensus.cc:385] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.506887 15512 raft_consensus.cc:740] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.509721 15512 consensus_queue.cc:260] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.511166 15550 raft_consensus.cc:515] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.513057 15513 raft_consensus.cc:515] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.514124 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8e27f1a110b46768ce90a7cf579c5c7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.514750 15319 raft_consensus.cc:3060] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.515516 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edba8ca9af3f45589c3bf2437e521a27" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.516037 15320 raft_consensus.cc:3060] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.519802 15512 ts_tablet_manager.cc:1434] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.018s user 0.004s sys 0.001s
I20260201 08:58:32.525023 15512 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.526621 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edba8ca9af3f45589c3bf2437e521a27" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:32.527212 15469 raft_consensus.cc:3060] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.527617 15508 tablet_bootstrap.cc:492] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.528062 15508 ts_tablet_manager.cc:1403] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.050s user 0.013s sys 0.000s
I20260201 08:58:32.530762 15508 raft_consensus.cc:359] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.524991 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8e27f1a110b46768ce90a7cf579c5c7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.531908 15508 raft_consensus.cc:385] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.532291 15395 raft_consensus.cc:3060] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.522832 15319 raft_consensus.cc:2468] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.523715 15550 leader_election.cc:290] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.523813 15513 leader_election.cc:290] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.532322 15508 raft_consensus.cc:740] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.535522 15509 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.532873 15538 raft_consensus.cc:493] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.532392 15512 tablet_bootstrap.cc:654] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.539412 15509 ts_tablet_manager.cc:1403] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.058s user 0.027s sys 0.020s
I20260201 08:58:32.539656 15435 leader_election.cc:304] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:32.540632 15550 raft_consensus.cc:2804] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.541141 15550 raft_consensus.cc:697] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.539461 15538 raft_consensus.cc:515] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.541915 15550 consensus_queue.cc:237] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.542253 15509 raft_consensus.cc:359] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.542973 15509 raft_consensus.cc:385] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.543269 15509 raft_consensus.cc:740] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.522692 15320 raft_consensus.cc:2468] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:32.543848 15509 consensus_queue.cc:260] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.544381 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.544482 15361 leader_election.cc:304] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:32.545173 15394 raft_consensus.cc:2393] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:32.545346 15513 raft_consensus.cc:2804] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.546130 15509 ts_tablet_manager.cc:1434] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:32.547058 15509 tablet_bootstrap.cc:492] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.546999 15508 consensus_queue.cc:260] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.547998 15538 leader_election.cc:290] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.548286 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10bddef534db4c1a811007e65a553a1c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.550005 15286 leader_election.cc:304] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:32.550969 15469 raft_consensus.cc:2468] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:32.554514 15565 raft_consensus.cc:493] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.552758 15509 tablet_bootstrap.cc:654] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.555603 15513 raft_consensus.cc:697] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:32.551093 15538 raft_consensus.cc:3060] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.558143 15513 consensus_queue.cc:237] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.562211 15565 raft_consensus.cc:515] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.558799 15395 raft_consensus.cc:2468] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.567869 15508 ts_tablet_manager.cc:1434] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.040s user 0.012s sys 0.010s
I20260201 08:58:32.568588 15508 tablet_bootstrap.cc:492] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.574947 15216 catalog_manager.cc:5654] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:32.576213 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd8fa6771ed43a38e4769a0d1863183" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.577795 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd8fa6771ed43a38e4769a0d1863183" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.578608 15508 tablet_bootstrap.cc:654] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.578406 15469 raft_consensus.cc:2468] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:32.580322 15361 leader_election.cc:304] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
W20260201 08:58:32.581179 15361 leader_election.cc:343] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.583062 15512 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.583487 15512 ts_tablet_manager.cc:1403] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.059s user 0.007s sys 0.011s
I20260201 08:58:32.585875 15512 raft_consensus.cc:359] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.575069 15565 leader_election.cc:290] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.586472 15512 raft_consensus.cc:385] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.586730 15512 raft_consensus.cc:740] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.587069 15565 raft_consensus.cc:2804] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.587765 15512 consensus_queue.cc:260] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.588150 15565 raft_consensus.cc:493] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.590509 15512 ts_tablet_manager.cc:1434] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20260201 08:58:32.591818 15512 tablet_bootstrap.cc:492] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.588688 15565 raft_consensus.cc:3060] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.598060 15512 tablet_bootstrap.cc:654] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.597059 15538 raft_consensus.cc:2749] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:32.599946 15565 raft_consensus.cc:515] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.603811 15218 catalog_manager.cc:5654] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:32.606885 15565 leader_election.cc:290] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.609117 15395 raft_consensus.cc:3060] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.610040 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd8fa6771ed43a38e4769a0d1863183" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.610834 15550 raft_consensus.cc:493] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.611187 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd8fa6771ed43a38e4769a0d1863183" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:32.611282 15550 raft_consensus.cc:515] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.612746 15469 raft_consensus.cc:3060] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.614115 15550 leader_election.cc:290] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.614827 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.615408 15320 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:32.615525 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.616518 15435 leader_election.cc:304] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
W20260201 08:58:32.617087 15433 leader_election.cc:343] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.617861 15550 raft_consensus.cc:2804] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260201 08:58:32.617260 15361 leader_election.cc:343] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.618182 15550 raft_consensus.cc:493] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.618527 15550 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.625026 15550 raft_consensus.cc:515] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.627943 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.628501 15320 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.628970 15509 tablet_bootstrap.cc:492] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.629400 15509 ts_tablet_manager.cc:1403] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.083s user 0.014s sys 0.000s
I20260201 08:58:32.630175 15508 tablet_bootstrap.cc:492] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.630282 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.630609 15508 ts_tablet_manager.cc:1403] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.009s
W20260201 08:58:32.631623 15433 leader_election.cc:343] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.632151 15550 leader_election.cc:290] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.628451 15469 raft_consensus.cc:2468] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:32.632881 15508 raft_consensus.cc:359] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.631834 15509 raft_consensus.cc:359] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.633877 15509 raft_consensus.cc:385] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.633515 15508 raft_consensus.cc:385] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.634545 15508 raft_consensus.cc:740] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.635229 15508 consensus_queue.cc:260] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.634229 15509 raft_consensus.cc:740] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.635859 15361 leader_election.cc:304] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:32.637871 15508 ts_tablet_manager.cc:1434] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:58:32.638262 15565 raft_consensus.cc:2804] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.638708 15508 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.638180 15509 consensus_queue.cc:260] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.638895 15565 raft_consensus.cc:697] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:32.639696 15565 consensus_queue.cc:237] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.635295 15320 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.644325 15435 leader_election.cc:304] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:32.645339 15509 ts_tablet_manager.cc:1434] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260201 08:58:32.646763 15509 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.646785 15508 tablet_bootstrap.cc:654] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.645732 15550 raft_consensus.cc:2804] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.647804 15550 raft_consensus.cc:697] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.648751 15550 consensus_queue.cc:237] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.653861 15508 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.655995 15512 tablet_bootstrap.cc:492] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.656451 15512 ts_tablet_manager.cc:1403] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.065s user 0.014s sys 0.016s
I20260201 08:58:32.656894 15508 ts_tablet_manager.cc:1403] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20260201 08:58:32.657521 15509 tablet_bootstrap.cc:654] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.659227 15508 raft_consensus.cc:359] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.659871 15508 raft_consensus.cc:385] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.660153 15508 raft_consensus.cc:740] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.660780 15508 consensus_queue.cc:260] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.662976 15508 ts_tablet_manager.cc:1434] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:32.662830 15512 raft_consensus.cc:359] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.663445 15512 raft_consensus.cc:385] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.663704 15512 raft_consensus.cc:740] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.664002 15508 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.664502 15512 consensus_queue.cc:260] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.669152 15514 raft_consensus.cc:493] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.668776 15218 catalog_manager.cc:5654] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:32.669575 15514 raft_consensus.cc:515] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.671479 15514 leader_election.cc:290] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.672449 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.673079 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.673684 15395 raft_consensus.cc:2468] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
W20260201 08:58:32.674312 15435 leader_election.cc:343] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.674851 15433 leader_election.cc:304] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:32.675977 15514 raft_consensus.cc:2804] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.676954 15514 raft_consensus.cc:493] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.677286 15514 raft_consensus.cc:3060] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.683823 15508 tablet_bootstrap.cc:654] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.685746 15537 consensus_queue.cc:1048] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:32.687417 15514 raft_consensus.cc:515] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.688645 15218 catalog_manager.cc:5654] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:32.690514 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
W20260201 08:58:32.691715 15435 leader_election.cc:343] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.694573 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.695212 15394 raft_consensus.cc:3060] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.674321 15512 ts_tablet_manager.cc:1434] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260201 08:58:32.700503 15512 tablet_bootstrap.cc:492] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.704788 15565 raft_consensus.cc:493] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.705300 15565 raft_consensus.cc:515] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.705533 15550 consensus_queue.cc:1048] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:32.705783 15394 raft_consensus.cc:2468] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.706908 15433 leader_election.cc:304] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:32.707293 15565 leader_election.cc:290] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.708597 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.710270 15537 raft_consensus.cc:2804] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.710747 15537 raft_consensus.cc:697] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.711568 15537 consensus_queue.cc:237] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.713907 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f803005bcce24dbea779215746b9d2ca" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.720705 15512 tablet_bootstrap.cc:654] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.721283 15361 leader_election.cc:304] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:32.722172 15565 raft_consensus.cc:2749] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:32.723223 15522 consensus_queue.cc:1048] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:32.729528 15509 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.730016 15509 ts_tablet_manager.cc:1403] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.083s user 0.021s sys 0.014s
I20260201 08:58:32.732537 15509 raft_consensus.cc:359] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.733222 15509 raft_consensus.cc:385] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.733493 15509 raft_consensus.cc:740] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.734200 15509 consensus_queue.cc:260] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.735981 15514 leader_election.cc:290] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.736281 15509 ts_tablet_manager.cc:1434] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:58:32.738183 15509 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.741382 15538 raft_consensus.cc:493] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.741925 15538 raft_consensus.cc:515] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.743866 15509 tablet_bootstrap.cc:654] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.744582 15538 leader_election.cc:290] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.749737 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.751415 15469 raft_consensus.cc:2468] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:32.752666 15286 leader_election.cc:304] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:32.753859 15521 raft_consensus.cc:2804] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.754245 15521 raft_consensus.cc:493] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.754565 15521 raft_consensus.cc:3060] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.761718 15395 raft_consensus.cc:3060] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.767217 15521 raft_consensus.cc:515] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.769609 15508 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.769109 15547 consensus_queue.cc:1048] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:32.769913 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.773159 15394 raft_consensus.cc:2468] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:32.770170 15508 ts_tablet_manager.cc:1403] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.106s user 0.006s sys 0.008s
I20260201 08:58:32.782797 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.783434 15395 raft_consensus.cc:3060] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.784124 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:32.784726 15469 raft_consensus.cc:3060] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.789613 15395 raft_consensus.cc:2468] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:32.790886 15284 leader_election.cc:304] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:32.791858 15538 raft_consensus.cc:2804] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.793434 15538 raft_consensus.cc:697] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:32.794245 15538 consensus_queue.cc:237] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.795506 15469 raft_consensus.cc:2468] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:32.797669 15521 leader_election.cc:290] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.797484 15508 raft_consensus.cc:359] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.805090 15508 raft_consensus.cc:385] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.805387 15508 raft_consensus.cc:740] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.805593 15512 tablet_bootstrap.cc:492] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.806109 15512 ts_tablet_manager.cc:1403] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.106s user 0.050s sys 0.021s
I20260201 08:58:32.806113 15508 consensus_queue.cc:260] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.809273 15512 raft_consensus.cc:359] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.809921 15512 raft_consensus.cc:385] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.810176 15512 raft_consensus.cc:740] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.810774 15512 consensus_queue.cc:260] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.810712 15218 catalog_manager.cc:5654] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:32.813702 15509 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.814188 15509 ts_tablet_manager.cc:1403] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.076s user 0.017s sys 0.024s
I20260201 08:58:32.816638 15508 ts_tablet_manager.cc:1434] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260201 08:58:32.816185 15216 catalog_manager.cc:5654] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:32.816602 15509 raft_consensus.cc:359] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.817705 15509 raft_consensus.cc:385] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.818136 15509 raft_consensus.cc:740] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.818979 15509 consensus_queue.cc:260] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.820781 15512 ts_tablet_manager.cc:1434] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260201 08:58:32.821462 15509 ts_tablet_manager.cc:1434] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260201 08:58:32.821689 15512 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.822422 15509 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.825142 15508 tablet_bootstrap.cc:492] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.828372 15512 tablet_bootstrap.cc:654] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.829555 15509 tablet_bootstrap.cc:654] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.831216 15565 raft_consensus.cc:493] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.831682 15565 raft_consensus.cc:515] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.833220 15508 tablet_bootstrap.cc:654] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.835536 15565 leader_election.cc:290] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.838418 15537 raft_consensus.cc:493] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.839119 15537 raft_consensus.cc:515] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.845557 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:32.846269 15469 raft_consensus.cc:2468] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:32.848778 15361 leader_election.cc:304] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:32.849848 15580 consensus_queue.cc:1048] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:32.841429 15537 leader_election.cc:290] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.850279 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.856998 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:32.871212 15318 raft_consensus.cc:2468] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:32.858225 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.872598 15435 leader_election.cc:304] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:32.873531 15580 raft_consensus.cc:2804] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.873886 15580 raft_consensus.cc:493] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.874231 15580 raft_consensus.cc:3060] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.851007 15565 raft_consensus.cc:2804] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.877490 15565 raft_consensus.cc:493] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.877843 15565 raft_consensus.cc:3060] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.880012 15508 tablet_bootstrap.cc:492] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.880564 15508 ts_tablet_manager.cc:1403] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.056s user 0.015s sys 0.002s
I20260201 08:58:32.883328 15508 raft_consensus.cc:359] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.884044 15508 raft_consensus.cc:385] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.884305 15508 raft_consensus.cc:740] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.885248 15508 consensus_queue.cc:260] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.891470 15508 ts_tablet_manager.cc:1434] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.011s user 0.008s sys 0.001s
I20260201 08:58:32.892505 15508 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.900005 15508 tablet_bootstrap.cc:654] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.892218 15580 raft_consensus.cc:515] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.902518 15509 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.903012 15509 ts_tablet_manager.cc:1403] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.081s user 0.037s sys 0.029s
I20260201 08:58:32.903554 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.904533 15318 raft_consensus.cc:3060] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.904959 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.905210 15565 raft_consensus.cc:515] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.906394 15395 raft_consensus.cc:2393] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3f02001764a476e95c2584a094fa7d6 in current term 1: Already voted for candidate 544080112cc84e33ae3530baadd1d0dd in this term.
I20260201 08:58:32.906765 15580 leader_election.cc:290] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.903568 15512 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.909368 15512 ts_tablet_manager.cc:1403] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.088s user 0.035s sys 0.043s
I20260201 08:58:32.910208 15509 raft_consensus.cc:359] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.910934 15509 raft_consensus.cc:385] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.911247 15509 raft_consensus.cc:740] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.912014 15318 raft_consensus.cc:2468] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.911926 15509 consensus_queue.cc:260] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.913528 15565 leader_election.cc:290] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:32.913605 15435 leader_election.cc:304] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:32.914429 15580 raft_consensus.cc:2804] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.914848 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:32.915596 15509 ts_tablet_manager.cc:1434] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.012s user 0.004s sys 0.002s
I20260201 08:58:32.916366 15580 raft_consensus.cc:697] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.917050 15509 tablet_bootstrap.cc:492] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.917336 15580 consensus_queue.cc:237] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.916646 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "601eb231d2e943dcb0d893b620bbf937" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:32.919554 15319 raft_consensus.cc:2393] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 544080112cc84e33ae3530baadd1d0dd in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:32.921005 15537 raft_consensus.cc:493] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:32.921512 15537 raft_consensus.cc:515] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.922457 15508 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.922613 15509 tablet_bootstrap.cc:654] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.922909 15508 ts_tablet_manager.cc:1403] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.008s
I20260201 08:58:32.923544 15537 leader_election.cc:290] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.911881 15512 raft_consensus.cc:359] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.925613 15512 raft_consensus.cc:385] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.925889 15512 raft_consensus.cc:740] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.925853 15508 raft_consensus.cc:359] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.926391 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:32.926577 15508 raft_consensus.cc:385] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.926596 15512 consensus_queue.cc:260] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.927028 15508 raft_consensus.cc:740] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.927682 15508 consensus_queue.cc:260] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.926234 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:32.929315 15435 leader_election.cc:343] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.929909 15508 ts_tablet_manager.cc:1434] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260201 08:58:32.930783 15508 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:32.931900 15512 ts_tablet_manager.cc:1434] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.022s user 0.005s sys 0.002s
I20260201 08:58:32.932749 15512 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:32.936566 15508 tablet_bootstrap.cc:654] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.938037 15318 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.933158 15395 raft_consensus.cc:2468] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:32.939838 15433 leader_election.cc:304] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:32.941118 15537 raft_consensus.cc:2804] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:32.941510 15537 raft_consensus.cc:493] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:32.941888 15537 raft_consensus.cc:3060] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.947211 15512 tablet_bootstrap.cc:654] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.949726 15537 raft_consensus.cc:515] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.950475 15550 consensus_queue.cc:1048] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:32.953044 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
W20260201 08:58:32.954186 15435 leader_election.cc:343] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:32.955735 15537 leader_election.cc:290] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:32.957808 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:32.959611 15395 raft_consensus.cc:3060] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:32.962004 15509 tablet_bootstrap.cc:492] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:32.962582 15509 ts_tablet_manager.cc:1403] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.046s user 0.019s sys 0.009s
I20260201 08:58:32.965219 15509 raft_consensus.cc:359] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.965977 15509 raft_consensus.cc:385] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.966308 15509 raft_consensus.cc:740] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.967007 15509 consensus_queue.cc:260] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.968570 15508 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:32.969141 15508 ts_tablet_manager.cc:1403] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.001s
I20260201 08:58:32.972019 15509 ts_tablet_manager.cc:1434] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260201 08:58:32.973202 15509 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:32.977347 15395 raft_consensus.cc:2468] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:32.978197 15361 leader_election.cc:304] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:32.979561 15509 tablet_bootstrap.cc:654] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:32.979496 15565 raft_consensus.cc:2749] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260201 08:58:32.980203 15433 leader_election.cc:304] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:32.983467 15580 raft_consensus.cc:2804] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:32.984014 15508 raft_consensus.cc:359] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.984886 15508 raft_consensus.cc:385] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:32.985365 15508 raft_consensus.cc:740] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:32.985903 15508 consensus_queue.cc:260] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.986493 15580 raft_consensus.cc:697] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:32.987365 15580 consensus_queue.cc:237] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.988684 15508 ts_tablet_manager.cc:1434] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.019s user 0.003s sys 0.002s
I20260201 08:58:32.995980 15512 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:32.996527 15512 ts_tablet_manager.cc:1403] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.064s user 0.018s sys 0.019s
I20260201 08:58:32.999253 15512 raft_consensus.cc:359] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:32.999951 15512 raft_consensus.cc:385] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.000211 15512 raft_consensus.cc:740] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.000349 15508 tablet_bootstrap.cc:492] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.000852 15512 consensus_queue.cc:260] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.007928 15512 ts_tablet_manager.cc:1434] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260201 08:58:33.009093 15512 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.009135 15508 tablet_bootstrap.cc:654] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.011194 15216 catalog_manager.cc:5654] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:33.014989 15509 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.015442 15509 ts_tablet_manager.cc:1403] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.042s user 0.013s sys 0.015s
I20260201 08:58:33.015848 15512 tablet_bootstrap.cc:654] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.017277 15565 raft_consensus.cc:493] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.017776 15565 raft_consensus.cc:515] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.017959 15509 raft_consensus.cc:359] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.018640 15509 raft_consensus.cc:385] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.018922 15509 raft_consensus.cc:740] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.019814 15565 leader_election.cc:290] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.019547 15509 consensus_queue.cc:260] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.021867 15509 ts_tablet_manager.cc:1434] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260201 08:58:33.022845 15509 tablet_bootstrap.cc:492] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:33.023293 15508 tablet_bootstrap.cc:492] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.023782 15508 ts_tablet_manager.cc:1403] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.006s
I20260201 08:58:33.026407 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:33.026739 15508 raft_consensus.cc:359] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.027577 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.028216 15469 raft_consensus.cc:2468] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:33.028815 15509 tablet_bootstrap.cc:654] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.027578 15508 raft_consensus.cc:385] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.029287 15361 leader_election.cc:304] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:33.029510 15508 raft_consensus.cc:740] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
W20260201 08:58:33.030150 15361 leader_election.cc:343] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.030242 15508 consensus_queue.cc:260] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.031985 15564 raft_consensus.cc:2804] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:33.032346 15564 raft_consensus.cc:493] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:33.032647 15564 raft_consensus.cc:3060] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.036464 15513 consensus_queue.cc:1048] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.039764 15564 raft_consensus.cc:515] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.043350 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:33.044150 15508 ts_tablet_manager.cc:1434] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.020s user 0.002s sys 0.004s
W20260201 08:58:33.044548 15361 leader_election.cc:343] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.044898 15538 raft_consensus.cc:493] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.045382 15512 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.045828 15512 ts_tablet_manager.cc:1403] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.024s
I20260201 08:58:33.046185 15564 leader_election.cc:290] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.046828 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:33.047447 15469 raft_consensus.cc:3060] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.048741 15512 raft_consensus.cc:359] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.049577 15512 raft_consensus.cc:385] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.049901 15512 raft_consensus.cc:740] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.050699 15512 consensus_queue.cc:260] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.053694 15512 ts_tablet_manager.cc:1434] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.008s user 0.004s sys 0.001s
I20260201 08:58:33.054740 15512 tablet_bootstrap.cc:492] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.045454 15538 raft_consensus.cc:515] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.058926 15538 leader_election.cc:290] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.061024 15508 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.063117 15509 tablet_bootstrap.cc:492] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.063572 15509 ts_tablet_manager.cc:1403] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.041s user 0.016s sys 0.012s
I20260201 08:58:33.063628 15512 tablet_bootstrap.cc:654] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.065114 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cce9e137d99477387581030f09ca781" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
W20260201 08:58:33.066833 15286 leader_election.cc:343] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.068411 15469 raft_consensus.cc:2468] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:33.069674 15538 raft_consensus.cc:493] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.070672 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cce9e137d99477387581030f09ca781" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:33.070133 15538 raft_consensus.cc:515] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.071381 15395 raft_consensus.cc:2468] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:33.073237 15361 leader_election.cc:304] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:33.075237 15508 tablet_bootstrap.cc:654] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.075222 15284 leader_election.cc:304] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.076313 15521 raft_consensus.cc:2804] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:33.076936 15513 raft_consensus.cc:2804] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:33.077106 15521 raft_consensus.cc:493] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:33.077530 15521 raft_consensus.cc:3060] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.077581 15513 raft_consensus.cc:697] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:33.078600 15513 consensus_queue.cc:237] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.082566 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:33.083348 15395 raft_consensus.cc:2393] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:33.084192 15586 raft_consensus.cc:493] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.084549 15521 raft_consensus.cc:515] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.084666 15586 raft_consensus.cc:515] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.075413 15538 leader_election.cc:290] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.087150 15586 leader_election.cc:290] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.087234 15521 leader_election.cc:290] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.083160 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.090307 15509 raft_consensus.cc:359] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.091111 15509 raft_consensus.cc:385] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.091362 15509 raft_consensus.cc:740] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.091964 15509 consensus_queue.cc:260] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.096031 15586 raft_consensus.cc:493] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.096700 15586 raft_consensus.cc:515] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.098412 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.098727 15586 leader_election.cc:290] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.098800 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cce9e137d99477387581030f09ca781" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:33.101125 15509 ts_tablet_manager.cc:1434] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.037s user 0.007s sys 0.002s
I20260201 08:58:33.099411 15319 raft_consensus.cc:3060] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.102020 15509 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:33.102344 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd8fa6771ed43a38e4769a0d1863183" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.102667 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8cce9e137d99477387581030f09ca781" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:33.103217 15395 raft_consensus.cc:3060] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.095225 15565 consensus_queue.cc:1048] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260201 08:58:33.106294 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:33.106895 15286 leader_election.cc:343] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:33.109373 15286 leader_election.cc:343] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.111335 15395 raft_consensus.cc:2468] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:33.103227 15468 raft_consensus.cc:2393] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate 544080112cc84e33ae3530baadd1d0dd in this term.
I20260201 08:58:33.112962 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd8fa6771ed43a38e4769a0d1863183" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:33.113906 15284 leader_election.cc:343] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.114629 15284 leader_election.cc:304] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.113757 15286 leader_election.cc:304] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.116004 15537 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.116755 15550 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.120519 15284 leader_election.cc:304] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.123153 15538 raft_consensus.cc:2804] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:33.123027 15286 leader_election.cc:304] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.128082 15565 raft_consensus.cc:493] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.128552 15565 raft_consensus.cc:515] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.131263 15565 leader_election.cc:290] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.131358 15395 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.124020 15521 raft_consensus.cc:2749] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.135607 15521 raft_consensus.cc:2749] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.124199 15586 raft_consensus.cc:3060] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.139907 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:33.141234 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.143939 15218 catalog_manager.cc:5654] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:33.147822 15361 leader_election.cc:343] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:33.148543 15361 leader_election.cc:343] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.148947 15361 leader_election.cc:304] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.150836 15512 tablet_bootstrap.cc:492] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.151335 15512 ts_tablet_manager.cc:1403] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.097s user 0.010s sys 0.023s
I20260201 08:58:33.154435 15512 raft_consensus.cc:359] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.154799 15537 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260201 08:58:33.164615 15512 raft_consensus.cc:385] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.165021 15512 raft_consensus.cc:740] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.136731 15217 catalog_manager.cc:5654] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:33.155292 15513 raft_consensus.cc:2749] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.218725 15565 consensus_queue.cc:1048] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260201 08:58:33.254617 15522 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.254721 15565 consensus_queue.cc:1048] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.225148 15538 raft_consensus.cc:697] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:33.276595 15538 consensus_queue.cc:237] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.312903 15512 consensus_queue.cc:260] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.310981 15586 raft_consensus.cc:2749] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.334857 15509 tablet_bootstrap.cc:654] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.337280 15512 ts_tablet_manager.cc:1434] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.186s user 0.028s sys 0.038s
I20260201 08:58:33.337960 15512 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.336470 15586 consensus_queue.cc:1048] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260201 08:58:33.349063 15508 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.349538 15508 ts_tablet_manager.cc:1403] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.289s user 0.010s sys 0.006s
I20260201 08:58:33.353055 15508 raft_consensus.cc:359] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.353695 15508 raft_consensus.cc:385] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.353945 15508 raft_consensus.cc:740] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.354591 15508 consensus_queue.cc:260] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.356141 15508 ts_tablet_manager.cc:1434] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260201 08:58:33.358319 15537 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.359335 15508 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.360294 15550 raft_consensus.cc:493] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.360756 15550 raft_consensus.cc:515] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:33.361991 15286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:39459, user_credentials={real_user=slave}} blocked reactor thread for 239018us
I20260201 08:58:33.373631 15514 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.371984 15537 raft_consensus.cc:493] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.374666 15537 raft_consensus.cc:515] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.376569 15537 leader_election.cc:290] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:33.377421 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:33.380028 15435 leader_election.cc:343] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.380697 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bc17c52abef44ba92ab2c0659577d3c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:33.381171 15550 leader_election.cc:290] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
W20260201 08:58:33.381935 15435 leader_election.cc:343] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:33.387631 15266 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:33.393405 15580 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.396211 15512 tablet_bootstrap.cc:654] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.398895 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bc17c52abef44ba92ab2c0659577d3c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:33.403446 15538 consensus_queue.cc:1048] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.404841 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:33.406098 15433 leader_election.cc:343] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.406598 15433 leader_election.cc:304] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:33.412551 15580 raft_consensus.cc:2749] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:58:33.422272 15435 consensus_peers.cc:597] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:33.430421 15218 catalog_manager.cc:5654] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:33.433583 15433 leader_election.cc:343] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.434334 15433 leader_election.cc:304] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:33.435140 15580 raft_consensus.cc:2749] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.438402 15508 tablet_bootstrap.cc:654] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.440425 15608 raft_consensus.cc:493] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.440829 15608 raft_consensus.cc:515] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.443588 15608 leader_election.cc:290] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.445549 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
W20260201 08:58:33.445874 15606 log.cc:927] Time spent T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6: Append to log took a long time: real 0.101s user 0.003s sys 0.000s
I20260201 08:58:33.446873 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:33.447187 15286 leader_election.cc:343] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.449071 15392 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:33.450222 15284 leader_election.cc:304] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.451232 15521 raft_consensus.cc:2804] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:33.451565 15521 raft_consensus.cc:493] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:33.451877 15521 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.459339 15521 raft_consensus.cc:515] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.462531 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:33.462787 15521 leader_election.cc:290] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.463191 15390 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.463928 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
W20260201 08:58:33.465268 15286 leader_election.cc:343] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.473794 15509 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.474287 15509 ts_tablet_manager.cc:1403] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.372s user 0.018s sys 0.001s
I20260201 08:58:33.483491 15512 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.484367 15512 ts_tablet_manager.cc:1403] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.147s user 0.010s sys 0.005s
I20260201 08:58:33.488695 15512 raft_consensus.cc:359] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.489395 15512 raft_consensus.cc:385] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.489670 15512 raft_consensus.cc:740] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.489835 15537 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.490358 15512 consensus_queue.cc:260] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.493245 15390 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:33.493638 15508 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.494091 15508 ts_tablet_manager.cc:1403] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.135s user 0.020s sys 0.009s
I20260201 08:58:33.495898 15284 leader_election.cc:304] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.497795 15521 raft_consensus.cc:2804] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:33.498251 15521 raft_consensus.cc:697] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:33.498600 15564 raft_consensus.cc:493] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.498996 15521 consensus_queue.cc:237] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.500375 15512 ts_tablet_manager.cc:1434] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.016s user 0.003s sys 0.003s
I20260201 08:58:33.501391 15512 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.499033 15564 raft_consensus.cc:515] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.503348 15580 raft_consensus.cc:493] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.504881 15317 raft_consensus.cc:3060] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.503793 15580 raft_consensus.cc:515] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.508139 15509 raft_consensus.cc:359] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.509315 15509 raft_consensus.cc:385] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.510458 15580 leader_election.cc:290] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:33.510911 15509 raft_consensus.cc:740] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.510910 15508 raft_consensus.cc:359] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.511900 15508 raft_consensus.cc:385] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.512416 15508 raft_consensus.cc:740] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.513976 15508 consensus_queue.cc:260] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.512936 15509 consensus_queue.cc:260] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.514716 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2f539e5f0bc47eeb6b625d9cdfc7327" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:33.515829 15564 leader_election.cc:290] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.517959 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.518424 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:33.519217 15361 leader_election.cc:343] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:33.519896 15361 leader_election.cc:343] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.520282 15361 leader_election.cc:304] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
W20260201 08:58:33.520602 15435 leader_election.cc:343] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.521286 15550 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.522323 15564 raft_consensus.cc:2749] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.524289 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2f539e5f0bc47eeb6b625d9cdfc7327" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:33.525637 15433 leader_election.cc:343] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.526049 15433 leader_election.cc:304] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:33.526806 15508 ts_tablet_manager.cc:1434] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.032s user 0.005s sys 0.001s
I20260201 08:58:33.527961 15508 tablet_bootstrap.cc:492] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.527050 15550 raft_consensus.cc:2749] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.532562 15509 ts_tablet_manager.cc:1434] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.058s user 0.006s sys 0.001s
I20260201 08:58:33.532892 15564 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.540282 15509 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:33.547180 15509 tablet_bootstrap.cc:654] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.557050 15512 tablet_bootstrap.cc:654] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.574544 15512 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.576714 15512 ts_tablet_manager.cc:1403] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.076s user 0.008s sys 0.006s
I20260201 08:58:33.580336 15218 catalog_manager.cc:5654] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:33.589248 15563 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:33.594818 15512 raft_consensus.cc:359] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.595609 15512 raft_consensus.cc:385] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.595886 15512 raft_consensus.cc:740] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.599681 15512 consensus_queue.cc:260] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.602131 15512 ts_tablet_manager.cc:1434] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.025s user 0.007s sys 0.001s
I20260201 08:58:33.602284 15508 tablet_bootstrap.cc:654] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.603951 15512 tablet_bootstrap.cc:492] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.608695 15509 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.609180 15509 ts_tablet_manager.cc:1403] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.069s user 0.018s sys 0.025s
I20260201 08:58:33.610724 15512 tablet_bootstrap.cc:654] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.617291 15508 tablet_bootstrap.cc:492] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.617856 15508 ts_tablet_manager.cc:1403] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.090s user 0.011s sys 0.008s
I20260201 08:58:33.617990 15509 raft_consensus.cc:359] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.618695 15509 raft_consensus.cc:385] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.618911 15509 raft_consensus.cc:740] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.619412 15509 consensus_queue.cc:260] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.621312 15508 raft_consensus.cc:359] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.622115 15508 raft_consensus.cc:385] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.622458 15508 raft_consensus.cc:740] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.623241 15508 consensus_queue.cc:260] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.628405 15508 ts_tablet_manager.cc:1434] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260201 08:58:33.629397 15508 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.633718 15509 ts_tablet_manager.cc:1434] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260201 08:58:33.634860 15509 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:33.640776 15509 tablet_bootstrap.cc:654] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.640919 15512 tablet_bootstrap.cc:492] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.642015 15512 ts_tablet_manager.cc:1403] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.038s user 0.017s sys 0.000s
I20260201 08:58:33.645267 15508 tablet_bootstrap.cc:654] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.649331 15508 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.649842 15508 ts_tablet_manager.cc:1403] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.003s
I20260201 08:58:33.652454 15508 raft_consensus.cc:359] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.654572 15508 raft_consensus.cc:385] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.650199 15512 raft_consensus.cc:359] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.654892 15508 raft_consensus.cc:740] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.655164 15512 raft_consensus.cc:385] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.655463 15512 raft_consensus.cc:740] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.655522 15508 consensus_queue.cc:260] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.656209 15512 consensus_queue.cc:260] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.657528 15508 ts_tablet_manager.cc:1434] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260201 08:58:33.658433 15508 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.663664 15508 tablet_bootstrap.cc:654] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.663971 15512 ts_tablet_manager.cc:1434] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260201 08:58:33.664877 15512 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.670676 15512 tablet_bootstrap.cc:654] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.675765 15509 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.676285 15509 ts_tablet_manager.cc:1403] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.011s
I20260201 08:58:33.678907 15509 raft_consensus.cc:359] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.679625 15509 raft_consensus.cc:385] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.679894 15509 raft_consensus.cc:740] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.683640 15512 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.684108 15512 ts_tablet_manager.cc:1403] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20260201 08:58:33.686506 15512 raft_consensus.cc:359] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.687207 15512 raft_consensus.cc:385] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.687462 15512 raft_consensus.cc:740] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.688035 15512 consensus_queue.cc:260] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.689105 15509 consensus_queue.cc:260] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.693970 15512 ts_tablet_manager.cc:1434] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260201 08:58:33.694937 15512 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.695636 15509 ts_tablet_manager.cc:1434] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.019s user 0.006s sys 0.001s
I20260201 08:58:33.696533 15509 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:33.700358 15512 tablet_bootstrap.cc:654] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.703498 15509 tablet_bootstrap.cc:654] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.705881 15508 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.706382 15508 ts_tablet_manager.cc:1403] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.048s user 0.015s sys 0.018s
I20260201 08:58:33.708717 15508 raft_consensus.cc:359] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.709372 15508 raft_consensus.cc:385] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.709630 15508 raft_consensus.cc:740] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.710268 15508 consensus_queue.cc:260] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.712081 15512 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.712512 15508 ts_tablet_manager.cc:1434] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260201 08:58:33.712523 15512 ts_tablet_manager.cc:1403] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.006s
I20260201 08:58:33.713496 15508 tablet_bootstrap.cc:492] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.720892 15512 raft_consensus.cc:359] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.721565 15512 raft_consensus.cc:385] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.721800 15512 raft_consensus.cc:740] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.722419 15512 consensus_queue.cc:260] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.723510 15508 tablet_bootstrap.cc:654] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.723879 15521 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.727859 15512 ts_tablet_manager.cc:1434] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.015s user 0.003s sys 0.001s
I20260201 08:58:33.728791 15512 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.734045 15512 tablet_bootstrap.cc:654] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.734899 15513 raft_consensus.cc:493] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.735404 15513 raft_consensus.cc:515] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.737403 15513 leader_election.cc:290] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.739758 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bc17c52abef44ba92ab2c0659577d3c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:33.740228 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bc17c52abef44ba92ab2c0659577d3c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.740401 15319 raft_consensus.cc:2468] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:33.740931 15468 raft_consensus.cc:2468] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:33.741688 15361 leader_election.cc:304] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:33.743268 15565 raft_consensus.cc:2804] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:33.743654 15565 raft_consensus.cc:493] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:33.743970 15565 raft_consensus.cc:3060] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.751428 15565 raft_consensus.cc:515] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.753463 15565 leader_election.cc:290] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.756667 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bc17c52abef44ba92ab2c0659577d3c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:33.757405 15319 raft_consensus.cc:3060] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.762526 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bc17c52abef44ba92ab2c0659577d3c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:33.763165 15468 raft_consensus.cc:3060] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.766752 15319 raft_consensus.cc:2468] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:33.768028 15361 leader_election.cc:304] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:33.768906 15513 raft_consensus.cc:2804] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:33.769367 15513 raft_consensus.cc:697] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:33.770159 15513 consensus_queue.cc:237] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.770154 15521 raft_consensus.cc:493] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.772543 15521 raft_consensus.cc:515] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.776312 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.777097 15521 leader_election.cc:290] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.777511 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:33.778101 15286 leader_election.cc:343] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.778126 15390 raft_consensus.cc:2468] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:33.779285 15513 raft_consensus.cc:493] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.779943 15513 raft_consensus.cc:515] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.780510 15284 leader_election.cc:304] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.781926 15513 leader_election.cc:290] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.782181 15521 raft_consensus.cc:2804] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:33.782629 15521 raft_consensus.cc:493] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:33.782939 15521 raft_consensus.cc:3060] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.783874 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:33.784425 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.784456 15319 raft_consensus.cc:2468] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
W20260201 08:58:33.785781 15361 leader_election.cc:343] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.786568 15361 leader_election.cc:304] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.787295 15513 raft_consensus.cc:2804] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:33.787664 15513 raft_consensus.cc:493] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:33.787986 15513 raft_consensus.cc:3060] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.789903 15218 catalog_manager.cc:5654] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:33.794545 15509 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.795087 15509 ts_tablet_manager.cc:1403] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.099s user 0.010s sys 0.000s
I20260201 08:58:33.798696 15509 raft_consensus.cc:359] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.799340 15509 raft_consensus.cc:385] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.799594 15509 raft_consensus.cc:740] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.800420 15468 raft_consensus.cc:2468] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:33.802554 15508 tablet_bootstrap.cc:492] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.802991 15508 ts_tablet_manager.cc:1403] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.090s user 0.024s sys 0.022s
I20260201 08:58:33.804217 15512 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.804700 15512 ts_tablet_manager.cc:1403] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.076s user 0.015s sys 0.007s
I20260201 08:58:33.805481 15508 raft_consensus.cc:359] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.805934 15521 raft_consensus.cc:515] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.807862 15468 raft_consensus.cc:3060] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.808707 15508 raft_consensus.cc:385] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.808565 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:33.809037 15508 raft_consensus.cc:740] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.809264 15395 raft_consensus.cc:3060] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.809734 15508 consensus_queue.cc:260] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.813102 15508 ts_tablet_manager.cc:1434] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260201 08:58:33.813948 15508 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.815980 15395 raft_consensus.cc:2468] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:33.817080 15284 leader_election.cc:304] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:33.817989 15610 raft_consensus.cc:2804] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:33.818446 15610 raft_consensus.cc:697] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:33.819265 15508 tablet_bootstrap.cc:654] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.819034 15538 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:33.819792 15610 consensus_queue.cc:237] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.822129 15509 consensus_queue.cc:260] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.823191 15608 raft_consensus.cc:493] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.823628 15608 raft_consensus.cc:515] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.827606 15608 leader_election.cc:290] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.827908 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:33.827878 15513 raft_consensus.cc:515] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.829308 15390 raft_consensus.cc:2468] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:33.828523 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.830304 15284 leader_election.cc:304] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:33.830605 15468 raft_consensus.cc:2468] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:33.830987 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:33.831182 15538 raft_consensus.cc:2804] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:33.831521 15319 raft_consensus.cc:3060] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.831971 15513 leader_election.cc:290] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.832428 15509 ts_tablet_manager.cc:1434] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.037s user 0.006s sys 0.002s
I20260201 08:58:33.831549 15538 raft_consensus.cc:493] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:33.832929 15538 raft_consensus.cc:3060] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.835527 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:33.836069 15468 raft_consensus.cc:3060] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.838327 15509 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:33.845765 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:33.846465 15319 raft_consensus.cc:2468] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:33.847669 15361 leader_election.cc:304] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
W20260201 08:58:33.847836 15286 leader_election.cc:343] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.848542 15513 raft_consensus.cc:2804] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:33.848790 15521 leader_election.cc:290] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.849234 15513 raft_consensus.cc:697] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:33.850082 15513 consensus_queue.cc:237] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.851836 15512 raft_consensus.cc:359] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.855499 15509 tablet_bootstrap.cc:654] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.857676 15512 raft_consensus.cc:385] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.858578 15468 raft_consensus.cc:2468] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:33.875070 15512 raft_consensus.cc:740] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.875972 15512 consensus_queue.cc:260] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.878858 15509 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.854984 15538 raft_consensus.cc:515] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.879334 15509 ts_tablet_manager.cc:1403] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.004s
I20260201 08:58:33.881515 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:33.881737 15509 raft_consensus.cc:359] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.882125 15390 raft_consensus.cc:3060] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.882400 15509 raft_consensus.cc:385] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.882671 15509 raft_consensus.cc:740] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.888543 15509 consensus_queue.cc:260] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.891053 15509 ts_tablet_manager.cc:1434] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260201 08:58:33.891906 15509 tablet_bootstrap.cc:492] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:33.897482 15509 tablet_bootstrap.cc:654] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.899852 15390 raft_consensus.cc:2468] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:33.874467 15216 catalog_manager.cc:5654] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:33.901400 15284 leader_election.cc:304] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:33.902180 15521 raft_consensus.cc:2804] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:33.902657 15521 raft_consensus.cc:697] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:33.903462 15521 consensus_queue.cc:237] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.904395 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:33.905357 15468 raft_consensus.cc:3060] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.910637 15550 raft_consensus.cc:493] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:33.911160 15550 raft_consensus.cc:515] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.912788 15468 raft_consensus.cc:2468] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:33.913180 15550 leader_election.cc:290] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:33.915074 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ea6d15904e84f4db55e93adfea29377" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:33.915571 15538 leader_election.cc:290] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
W20260201 08:58:33.916644 15433 leader_election.cc:343] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.917718 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ea6d15904e84f4db55e93adfea29377" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:33.919018 15435 leader_election.cc:343] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:33.919473 15435 leader_election.cc:304] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:33.921648 15580 raft_consensus.cc:2749] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.928555 15512 ts_tablet_manager.cc:1434] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.124s user 0.005s sys 0.001s
I20260201 08:58:33.929597 15512 tablet_bootstrap.cc:492] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.936615 15216 catalog_manager.cc:5654] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:33.957032 15512 tablet_bootstrap.cc:654] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.957809 15521 raft_consensus.cc:493] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:58:33.957844 15286 consensus_peers.cc:597] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:33.958756 15521 raft_consensus.cc:515] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.960963 15521 leader_election.cc:290] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:33.961850 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:33.964129 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:33.965296 15216 catalog_manager.cc:5654] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:33.966358 15508 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:33.966164 15286 leader_election.cc:304] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:33.966992 15508 ts_tablet_manager.cc:1403] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.153s user 0.038s sys 0.045s
I20260201 08:58:33.967753 15521 raft_consensus.cc:2749] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:33.969720 15509 tablet_bootstrap.cc:492] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:33.969796 15508 raft_consensus.cc:359] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.970201 15509 ts_tablet_manager.cc:1403] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.078s user 0.006s sys 0.018s
I20260201 08:58:33.970527 15508 raft_consensus.cc:385] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.970489 15512 tablet_bootstrap.cc:492] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:33.971004 15508 raft_consensus.cc:740] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.971246 15512 ts_tablet_manager.cc:1403] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.042s user 0.008s sys 0.004s
I20260201 08:58:33.971760 15508 consensus_queue.cc:260] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.974025 15508 ts_tablet_manager.cc:1434] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260201 08:58:33.974229 15319 raft_consensus.cc:3060] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:33.975594 15508 tablet_bootstrap.cc:492] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:33.974167 15512 raft_consensus.cc:359] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.976063 15512 raft_consensus.cc:385] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.976392 15512 raft_consensus.cc:740] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.977048 15512 consensus_queue.cc:260] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.979095 15512 ts_tablet_manager.cc:1434] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:58:33.980254 15512 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:33.981711 15508 tablet_bootstrap.cc:654] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:33.988047 15509 raft_consensus.cc:359] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.988754 15509 raft_consensus.cc:385] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:33.989012 15509 raft_consensus.cc:740] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:33.990531 15509 consensus_queue.cc:260] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:33.993177 15509 ts_tablet_manager.cc:1434] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260201 08:58:33.995643 15509 tablet_bootstrap.cc:492] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.001915 15512 tablet_bootstrap.cc:654] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.012712 15512 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.013098 15508 tablet_bootstrap.cc:492] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.013105 15512 ts_tablet_manager.cc:1403] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.004s
I20260201 08:58:34.013675 15508 ts_tablet_manager.cc:1403] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.038s user 0.023s sys 0.006s
I20260201 08:58:34.014155 15509 tablet_bootstrap.cc:654] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.015638 15512 raft_consensus.cc:359] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.016101 15512 raft_consensus.cc:385] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.016299 15512 raft_consensus.cc:740] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.016495 15508 raft_consensus.cc:359] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.017169 15508 raft_consensus.cc:385] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.017019 15512 consensus_queue.cc:260] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.017395 15508 raft_consensus.cc:740] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.018232 15508 consensus_queue.cc:260] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.019320 15509 tablet_bootstrap.cc:492] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.019729 15509 ts_tablet_manager.cc:1403] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.024s user 0.009s sys 0.000s
I20260201 08:58:34.020008 15508 ts_tablet_manager.cc:1434] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:34.021533 15512 ts_tablet_manager.cc:1434] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:58:34.022369 15512 tablet_bootstrap.cc:492] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.022516 15509 raft_consensus.cc:359] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.022877 15508 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.023149 15509 raft_consensus.cc:385] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.023427 15509 raft_consensus.cc:740] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.023994 15509 consensus_queue.cc:260] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.028132 15512 tablet_bootstrap.cc:654] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.029415 15508 tablet_bootstrap.cc:654] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.034350 15550 raft_consensus.cc:493] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.035380 15550 raft_consensus.cc:515] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.038484 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.039536 15550 leader_election.cc:290] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.041388 15509 ts_tablet_manager.cc:1434] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.021s user 0.008s sys 0.001s
I20260201 08:58:34.044682 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.045329 15390 raft_consensus.cc:2468] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:34.045696 15509 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
W20260201 08:58:34.046766 15435 leader_election.cc:343] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.047994 15433 leader_election.cc:304] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:34.049247 15550 raft_consensus.cc:2804] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.050215 15550 raft_consensus.cc:493] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:34.050541 15550 raft_consensus.cc:3060] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.057482 15509 tablet_bootstrap.cc:654] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.059124 15521 consensus_queue.cc:1048] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.064736 15550 raft_consensus.cc:515] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.077097 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:34.077739 15395 raft_consensus.cc:3060] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.079767 15580 raft_consensus.cc:493] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.080222 15580 raft_consensus.cc:515] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.080829 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:34.082104 15580 leader_election.cc:290] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.083854 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.084188 15395 raft_consensus.cc:2468] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
W20260201 08:58:34.084067 15435 leader_election.cc:343] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.084967 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.069775 15512 tablet_bootstrap.cc:492] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.085799 15550 leader_election.cc:290] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.085644 15433 leader_election.cc:304] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:34.087195 15512 ts_tablet_manager.cc:1403] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.065s user 0.015s sys 0.015s
I20260201 08:58:34.072688 15509 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.088168 15509 ts_tablet_manager.cc:1403] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.043s user 0.010s sys 0.007s
I20260201 08:58:34.085987 15390 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:34.089792 15433 leader_election.cc:304] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:34.090001 15512 raft_consensus.cc:359] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.090739 15580 raft_consensus.cc:2804] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:34.090842 15512 raft_consensus.cc:385] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.085649 15319 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:34.091361 15550 raft_consensus.cc:2804] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.091351 15512 raft_consensus.cc:740] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.091821 15550 raft_consensus.cc:493] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:34.090634 15509 raft_consensus.cc:359] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.092279 15550 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.092455 15509 raft_consensus.cc:385] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.093894 15509 raft_consensus.cc:740] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.094688 15509 consensus_queue.cc:260] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.095495 15508 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.095983 15508 ts_tablet_manager.cc:1403] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.073s user 0.033s sys 0.035s
I20260201 08:58:34.092288 15512 consensus_queue.cc:260] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.098627 15508 raft_consensus.cc:359] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.099279 15508 raft_consensus.cc:385] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.099535 15508 raft_consensus.cc:740] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.100659 15512 ts_tablet_manager.cc:1434] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260201 08:58:34.101692 15512 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.101326 15508 consensus_queue.cc:260] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.103693 15508 ts_tablet_manager.cc:1434] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260201 08:58:34.104725 15508 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.107776 15512 tablet_bootstrap.cc:654] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.110634 15508 tablet_bootstrap.cc:654] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.112329 15509 ts_tablet_manager.cc:1434] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.024s user 0.009s sys 0.003s
I20260201 08:58:34.110666 15550 raft_consensus.cc:515] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.116019 15550 leader_election.cc:290] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.117280 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:34.119047 15390 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.121412 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:34.122750 15319 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.126777 15509 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.135280 15319 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:34.138854 15580 raft_consensus.cc:697] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:34.145465 15580 consensus_queue.cc:237] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.148438 15390 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:34.150628 15435 leader_election.cc:304] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:34.154603 15509 tablet_bootstrap.cc:654] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.155354 15580 raft_consensus.cc:2804] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:34.155854 15580 raft_consensus.cc:697] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:34.156652 15580 consensus_queue.cc:237] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.157905 15586 raft_consensus.cc:493] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.158372 15586 raft_consensus.cc:515] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.159300 15218 catalog_manager.cc:5654] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:34.160193 15586 leader_election.cc:290] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.161934 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "baa1e353775e4af5a659c0d25dc5d48b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:34.163625 15284 leader_election.cc:343] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.165316 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "baa1e353775e4af5a659c0d25dc5d48b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
W20260201 08:58:34.166559 15286 leader_election.cc:343] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.166944 15286 leader_election.cc:304] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:34.167914 15586 raft_consensus.cc:2749] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.160410 15660 raft_consensus.cc:493] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.173166 15660 raft_consensus.cc:515] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.176913 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.179700 15660 leader_election.cc:290] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.180191 15512 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.180647 15512 ts_tablet_manager.cc:1403] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.079s user 0.020s sys 0.034s
I20260201 08:58:34.181203 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.182518 15433 leader_election.cc:304] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:34.183454 15508 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.183773 15580 raft_consensus.cc:2749] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.183894 15508 ts_tablet_manager.cc:1403] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.079s user 0.018s sys 0.035s
I20260201 08:58:34.187588 15218 catalog_manager.cc:5654] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:34.200968 15508 raft_consensus.cc:359] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.201167 15512 raft_consensus.cc:359] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.201948 15512 raft_consensus.cc:385] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.201833 15508 raft_consensus.cc:385] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.202376 15512 raft_consensus.cc:740] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.202533 15508 raft_consensus.cc:740] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.203310 15512 consensus_queue.cc:260] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.203406 15508 consensus_queue.cc:260] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.209632 15508 ts_tablet_manager.cc:1434] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.025s user 0.014s sys 0.000s
I20260201 08:58:34.210557 15508 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.210978 15512 ts_tablet_manager.cc:1434] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.029s user 0.006s sys 0.004s
I20260201 08:58:34.211941 15512 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.220392 15512 tablet_bootstrap.cc:654] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.220621 15509 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.223908 15509 ts_tablet_manager.cc:1403] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.097s user 0.009s sys 0.012s
I20260201 08:58:34.221104 15580 raft_consensus.cc:493] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.227933 15580 raft_consensus.cc:515] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.229103 15586 raft_consensus.cc:493] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.229665 15512 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.229465 15586 raft_consensus.cc:515] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.230095 15512 ts_tablet_manager.cc:1403] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.005s
I20260201 08:58:34.230373 15580 leader_election.cc:290] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.222698 15667 raft_consensus.cc:493] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.223104 15508 tablet_bootstrap.cc:654] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.231341 15586 leader_election.cc:290] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.226984 15509 raft_consensus.cc:359] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.231869 15509 raft_consensus.cc:385] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.232142 15509 raft_consensus.cc:740] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.232412 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.233152 15390 raft_consensus.cc:2393] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3f02001764a476e95c2584a094fa7d6 in current term 1: Already voted for candidate 30f18d77acb94b73a5ef2abf32e480d3 in this term.
I20260201 08:58:34.232715 15509 consensus_queue.cc:260] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.231339 15667 raft_consensus.cc:515] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.235235 15509 ts_tablet_manager.cc:1434] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.011s user 0.004s sys 0.002s
I20260201 08:58:34.236171 15509 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.237219 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2f539e5f0bc47eeb6b625d9cdfc7327" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.237152 15512 raft_consensus.cc:359] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.237396 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ea6d15904e84f4db55e93adfea29377" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.237893 15319 raft_consensus.cc:2468] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:34.237998 15467 raft_consensus.cc:2468] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:34.239564 15361 leader_election.cc:304] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:34.240746 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2f539e5f0bc47eeb6b625d9cdfc7327" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.241017 15512 raft_consensus.cc:385] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.241367 15467 raft_consensus.cc:2468] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:34.241317 15512 raft_consensus.cc:740] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.242760 15286 leader_election.cc:304] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:34.242565 15512 consensus_queue.cc:260] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.243680 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ea6d15904e84f4db55e93adfea29377" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.244086 15509 tablet_bootstrap.cc:654] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.244259 15390 raft_consensus.cc:2468] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:34.236088 15667 leader_election.cc:290] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.245108 15608 raft_consensus.cc:2804] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.245463 15608 raft_consensus.cc:493] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:34.245796 15608 raft_consensus.cc:3060] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.245973 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.246982 15565 raft_consensus.cc:2804] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.247354 15565 raft_consensus.cc:493] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:34.249531 15435 leader_election.cc:304] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:34.249909 15565 raft_consensus.cc:3060] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.249986 15512 ts_tablet_manager.cc:1434] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260201 08:58:34.250576 15580 raft_consensus.cc:3060] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.254688 15608 raft_consensus.cc:515] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.250953 15512 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.257346 15608 leader_election.cc:290] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.256451 15565 raft_consensus.cc:515] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.258416 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ea6d15904e84f4db55e93adfea29377" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:34.258970 15390 raft_consensus.cc:3060] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.259693 15565 leader_election.cc:290] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.262439 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5ea6d15904e84f4db55e93adfea29377" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:34.263108 15467 raft_consensus.cc:3060] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.263726 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2f539e5f0bc47eeb6b625d9cdfc7327" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:34.264248 15319 raft_consensus.cc:3060] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.266347 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2f539e5f0bc47eeb6b625d9cdfc7327" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:34.266875 15468 raft_consensus.cc:3060] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.267314 15580 raft_consensus.cc:2749] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.271517 15319 raft_consensus.cc:2468] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:34.273659 15361 leader_election.cc:304] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:34.274561 15565 raft_consensus.cc:2804] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:34.275730 15565 raft_consensus.cc:697] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:34.276424 15390 raft_consensus.cc:2468] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:34.276973 15565 consensus_queue.cc:237] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.277712 15284 leader_election.cc:304] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:34.278633 15508 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.278580 15608 raft_consensus.cc:2804] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:34.279258 15508 ts_tablet_manager.cc:1403] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.069s user 0.007s sys 0.012s
I20260201 08:58:34.275552 15467 raft_consensus.cc:2468] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:34.279939 15608 raft_consensus.cc:697] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:34.282637 15512 tablet_bootstrap.cc:654] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.282217 15608 consensus_queue.cc:237] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.285629 15468 raft_consensus.cc:2468] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:34.288079 15508 raft_consensus.cc:359] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.288713 15508 raft_consensus.cc:385] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.289008 15508 raft_consensus.cc:740] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.289605 15508 consensus_queue.cc:260] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.291623 15508 ts_tablet_manager.cc:1434] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.012s user 0.003s sys 0.000s
I20260201 08:58:34.293962 15508 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.295861 15509 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.296212 15509 ts_tablet_manager.cc:1403] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.060s user 0.016s sys 0.010s
I20260201 08:58:34.299173 15217 catalog_manager.cc:5654] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:34.301066 15509 raft_consensus.cc:359] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.301775 15509 raft_consensus.cc:385] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.302022 15509 raft_consensus.cc:740] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.302525 15509 consensus_queue.cc:260] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.308929 15509 ts_tablet_manager.cc:1434] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260201 08:58:34.309823 15509 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.310642 15218 catalog_manager.cc:5654] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:34.311401 15508 tablet_bootstrap.cc:654] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.314232 15565 consensus_queue.cc:1048] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.317976 15509 tablet_bootstrap.cc:654] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.336163 15508 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.336640 15508 ts_tablet_manager.cc:1403] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.044s user 0.013s sys 0.004s
I20260201 08:58:34.342744 15610 raft_consensus.cc:493] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.343201 15610 raft_consensus.cc:515] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.344944 15512 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.345448 15512 ts_tablet_manager.cc:1403] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.095s user 0.009s sys 0.004s
I20260201 08:58:34.346824 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86eab638067c49e79e1bdd4a3902cf7b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.346519 15565 consensus_queue.cc:1048] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260201 08:58:34.348242 15284 leader_election.cc:343] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.349129 15610 leader_election.cc:290] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.349500 15667 raft_consensus.cc:493] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.355834 15508 raft_consensus.cc:359] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.356590 15508 raft_consensus.cc:385] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.356884 15508 raft_consensus.cc:740] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.357538 15508 consensus_queue.cc:260] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.349944 15667 raft_consensus.cc:515] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.362906 15509 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.363358 15509 ts_tablet_manager.cc:1403] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.014s
I20260201 08:58:34.363672 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86eab638067c49e79e1bdd4a3902cf7b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.365291 15508 ts_tablet_manager.cc:1434] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260201 08:58:34.364266 15467 raft_consensus.cc:2468] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:34.366221 15508 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.366034 15512 raft_consensus.cc:359] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.366725 15512 raft_consensus.cc:385] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.366966 15512 raft_consensus.cc:740] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.367542 15512 consensus_queue.cc:260] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.368602 15509 raft_consensus.cc:359] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.369266 15509 raft_consensus.cc:385] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.369496 15509 raft_consensus.cc:740] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.370338 15509 consensus_queue.cc:260] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.370371 15586 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260201 08:58:34.377241 15509 ts_tablet_manager.cc:1434] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.014s user 0.007s sys 0.005s
I20260201 08:58:34.378094 15509 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.369316 15286 leader_election.cc:304] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:34.381163 15586 raft_consensus.cc:2804] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.381505 15586 raft_consensus.cc:493] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:34.381821 15586 raft_consensus.cc:3060] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.370401 15667 leader_election.cc:290] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.388715 15508 tablet_bootstrap.cc:654] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.389520 15512 ts_tablet_manager.cc:1434] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.044s user 0.005s sys 0.003s
I20260201 08:58:34.389475 15608 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:34.391407 15512 tablet_bootstrap.cc:492] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.400467 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cde26b6b4d4157a86e3c2b67ca2d72" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.408377 15586 raft_consensus.cc:515] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.414137 15586 leader_election.cc:290] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
W20260201 08:58:34.414554 15361 leader_election.cc:343] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.416381 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86eab638067c49e79e1bdd4a3902cf7b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:34.416980 15469 raft_consensus.cc:3060] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.418078 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cde26b6b4d4157a86e3c2b67ca2d72" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.419252 15565 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.416988 15468 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.424516 15586 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260201 08:58:34.446079 15361 leader_election.cc:343] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.446444 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86eab638067c49e79e1bdd4a3902cf7b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:34.446537 15361 leader_election.cc:304] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
W20260201 08:58:34.447901 15284 leader_election.cc:343] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.434783 15608 raft_consensus.cc:493] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.458896 15509 tablet_bootstrap.cc:654] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.449383 15513 raft_consensus.cc:2749] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.461087 15608 raft_consensus.cc:515] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.484364 15513 raft_consensus.cc:493] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.497220 15469 raft_consensus.cc:2468] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:34.498586 15286 leader_election.cc:304] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:34.499688 15608 leader_election.cc:290] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.500241 15608 raft_consensus.cc:2804] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:34.500736 15608 raft_consensus.cc:697] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:34.500759 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.502230 15394 raft_consensus.cc:2393] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:34.505267 15580 raft_consensus.cc:493] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.505738 15580 raft_consensus.cc:515] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.507639 15580 leader_election.cc:290] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.509228 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "baa1e353775e4af5a659c0d25dc5d48b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.509862 15317 raft_consensus.cc:2468] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:34.511087 15435 leader_election.cc:304] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:34.501524 15608 consensus_queue.cc:237] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.512131 15661 raft_consensus.cc:2804] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.512461 15661 raft_consensus.cc:493] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:34.512786 15661 raft_consensus.cc:3060] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.484850 15513 raft_consensus.cc:515] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.518880 15512 tablet_bootstrap.cc:654] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.550704 15550 raft_consensus.cc:493] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.551905 15667 raft_consensus.cc:493] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.552083 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "baa1e353775e4af5a659c0d25dc5d48b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.562242 15667 raft_consensus.cc:515] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.563985 15565 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.565562 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.566136 15667 leader_election.cc:290] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.562487 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d06ae7b6994d4f5a99bb33b73a0719d0" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.558516 15513 leader_election.cc:290] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.562053 15550 raft_consensus.cc:515] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.563365 15394 raft_consensus.cc:2468] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:34.572172 15286 leader_election.cc:304] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:34.575095 15508 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.575330 15550 leader_election.cc:290] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.575546 15508 ts_tablet_manager.cc:1403] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.210s user 0.013s sys 0.013s
I20260201 08:58:34.578354 15508 raft_consensus.cc:359] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.578996 15508 raft_consensus.cc:385] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.579250 15508 raft_consensus.cc:740] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.579977 15508 consensus_queue.cc:260] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.586094 15610 raft_consensus.cc:3060] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:58:34.589903 15682 log.cc:927] Time spent T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
I20260201 08:58:34.593953 15508 ts_tablet_manager.cc:1434] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20260201 08:58:34.594705 15508 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.608247 15610 raft_consensus.cc:2749] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.608825 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.609733 15684 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 08:58:34.611683 15361 leader_election.cc:343] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.613216 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a39e92ebc0d4bc89814ec24579af33c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.584522 15661 raft_consensus.cc:515] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.626066 15661 leader_election.cc:290] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:34.614820 15521 raft_consensus.cc:493] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.626718 15521 raft_consensus.cc:515] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:34.620235 15266 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:34.631347 15512 tablet_bootstrap.cc:492] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.631855 15512 ts_tablet_manager.cc:1403] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.241s user 0.014s sys 0.000s
W20260201 08:58:34.632301 15361 leader_election.cc:343] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.632910 15521 leader_election.cc:290] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.622221 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.628753 15688 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260201 08:58:34.632357 15509 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.640704 15509 ts_tablet_manager.cc:1403] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.263s user 0.016s sys 0.033s
I20260201 08:58:34.644557 15512 raft_consensus.cc:359] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.645470 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.648226 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a39e92ebc0d4bc89814ec24579af33c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.648258 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.653615 15218 catalog_manager.cc:5654] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:34.654574 15467 raft_consensus.cc:2468] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
W20260201 08:58:34.649200 15433 leader_election.cc:343] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.652256 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.652335 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "baa1e353775e4af5a659c0d25dc5d48b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
W20260201 08:58:34.656123 15286 leader_election.cc:343] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.656515 15392 raft_consensus.cc:3060] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.653823 15512 raft_consensus.cc:385] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.660751 15512 raft_consensus.cc:740] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.661525 15512 consensus_queue.cc:260] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:34.662840 15435 leader_election.cc:343] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.662662 15661 consensus_queue.cc:1048] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.663259 15435 leader_election.cc:304] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:34.663331 15688 consensus_queue.cc:1048] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.664577 15661 raft_consensus.cc:2749] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.665740 15508 tablet_bootstrap.cc:654] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.667354 15512 ts_tablet_manager.cc:1434] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20260201 08:58:34.668159 15512 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.672917 15509 raft_consensus.cc:359] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.673508 15509 raft_consensus.cc:385] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.673718 15509 raft_consensus.cc:740] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.675375 15509 consensus_queue.cc:260] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.677359 15509 ts_tablet_manager.cc:1434] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.036s user 0.005s sys 0.000s
W20260201 08:58:34.678205 15284 leader_election.cc:343] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.678656 15284 leader_election.cc:304] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
W20260201 08:58:34.679242 15361 leader_election.cc:343] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.679349 15538 raft_consensus.cc:2749] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.680344 15361 leader_election.cc:304] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:34.681313 15565 raft_consensus.cc:2749] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.682407 15361 leader_election.cc:304] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:34.682827 15392 raft_consensus.cc:2468] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:34.691365 15433 leader_election.cc:304] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:34.692175 15661 raft_consensus.cc:2804] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:34.692502 15565 raft_consensus.cc:2804] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.692912 15565 raft_consensus.cc:493] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:34.693244 15565 raft_consensus.cc:3060] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.693152 15538 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.692663 15661 raft_consensus.cc:697] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:34.694269 15661 consensus_queue.cc:237] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.705711 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "baa1e353775e4af5a659c0d25dc5d48b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:34.706364 15319 raft_consensus.cc:3060] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.707371 15565 raft_consensus.cc:515] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.711408 15512 tablet_bootstrap.cc:654] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.715001 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a39e92ebc0d4bc89814ec24579af33c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
W20260201 08:58:34.716602 15361 leader_election.cc:343] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.718168 15565 leader_election.cc:290] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.718636 15509 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.718156 15319 raft_consensus.cc:2468] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:34.719599 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a39e92ebc0d4bc89814ec24579af33c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:34.722958 15465 raft_consensus.cc:3060] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.730108 15465 raft_consensus.cc:2468] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:34.731418 15361 leader_election.cc:304] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:34.732360 15680 raft_consensus.cc:2804] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:34.732849 15680 raft_consensus.cc:697] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:34.733675 15680 consensus_queue.cc:237] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.738677 15509 tablet_bootstrap.cc:654] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.746723 15565 consensus_queue.cc:1048] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.750105 15217 catalog_manager.cc:5654] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:34.759058 15661 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.767868 15508 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.768446 15508 ts_tablet_manager.cc:1403] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.174s user 0.022s sys 0.016s
I20260201 08:58:34.770872 15508 raft_consensus.cc:359] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.771569 15508 raft_consensus.cc:385] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.771834 15508 raft_consensus.cc:740] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.772439 15508 consensus_queue.cc:260] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.776307 15508 ts_tablet_manager.cc:1434] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260201 08:58:34.781297 15679 raft_consensus.cc:493] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.782037 15508 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.781771 15679 raft_consensus.cc:515] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.784277 15679 leader_election.cc:290] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.785769 15216 catalog_manager.cc:5654] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:34.788446 15667 consensus_queue.cc:1048] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.789129 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86eab638067c49e79e1bdd4a3902cf7b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.789891 15466 raft_consensus.cc:2393] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544080112cc84e33ae3530baadd1d0dd in current term 1: Already voted for candidate 30f18d77acb94b73a5ef2abf32e480d3 in this term.
I20260201 08:58:34.794155 15521 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:34.816020 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86eab638067c49e79e1bdd4a3902cf7b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.818578 15509 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.820047 15509 ts_tablet_manager.cc:1403] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.102s user 0.014s sys 0.011s
I20260201 08:58:34.820616 15361 leader_election.cc:304] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:34.818626 15508 tablet_bootstrap.cc:654] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.822636 15679 raft_consensus.cc:3060] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:34.824844 15512 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.832990 15512 ts_tablet_manager.cc:1403] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.165s user 0.027s sys 0.027s
I20260201 08:58:34.837819 15512 raft_consensus.cc:359] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.838490 15512 raft_consensus.cc:385] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.838754 15512 raft_consensus.cc:740] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.839370 15512 consensus_queue.cc:260] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.826830 15509 raft_consensus.cc:359] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.841599 15509 raft_consensus.cc:385] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.841888 15509 raft_consensus.cc:740] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.845295 15509 consensus_queue.cc:260] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.854854 15512 ts_tablet_manager.cc:1434] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.022s user 0.003s sys 0.002s
I20260201 08:58:34.855844 15512 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.857635 15508 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.858147 15508 ts_tablet_manager.cc:1403] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.080s user 0.016s sys 0.025s
I20260201 08:58:34.858418 15509 ts_tablet_manager.cc:1434] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.038s user 0.002s sys 0.007s
I20260201 08:58:34.859297 15509 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.860678 15508 raft_consensus.cc:359] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.861450 15508 raft_consensus.cc:385] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.861753 15508 raft_consensus.cc:740] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.863265 15508 consensus_queue.cc:260] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.865765 15508 ts_tablet_manager.cc:1434] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260201 08:58:34.866683 15508 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.872537 15508 tablet_bootstrap.cc:654] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.874703 15512 tablet_bootstrap.cc:654] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.880735 15679 raft_consensus.cc:2749] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.885004 15508 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.885046 15509 tablet_bootstrap.cc:654] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.888917 15508 ts_tablet_manager.cc:1403] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.003s
I20260201 08:58:34.891252 15508 raft_consensus.cc:359] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.891876 15508 raft_consensus.cc:385] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.892133 15508 raft_consensus.cc:740] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.892475 15610 raft_consensus.cc:493] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.892736 15508 consensus_queue.cc:260] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.893085 15610 raft_consensus.cc:515] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.894826 15512 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:34.894922 15508 ts_tablet_manager.cc:1434] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:58:34.895534 15512 ts_tablet_manager.cc:1403] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.040s user 0.016s sys 0.003s
I20260201 08:58:34.895987 15508 tablet_bootstrap.cc:492] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.897416 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e978370deeb04e9d85cf2cc3c936672b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
W20260201 08:58:34.899302 15286 leader_election.cc:343] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.902091 15508 tablet_bootstrap.cc:654] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.900619 15512 raft_consensus.cc:359] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.902928 15512 raft_consensus.cc:385] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.903244 15512 raft_consensus.cc:740] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.903955 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e978370deeb04e9d85cf2cc3c936672b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:34.903936 15512 consensus_queue.cc:260] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.894995 15610 leader_election.cc:290] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
W20260201 08:58:34.905534 15284 leader_election.cc:343] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.903951 15509 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.906317 15509 ts_tablet_manager.cc:1403] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.006s
I20260201 08:58:34.906500 15512 ts_tablet_manager.cc:1434] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260201 08:58:34.907439 15512 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:34.908900 15509 raft_consensus.cc:359] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.910722 15509 raft_consensus.cc:385] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.911005 15509 raft_consensus.cc:740] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.911626 15509 consensus_queue.cc:260] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.913877 15509 ts_tablet_manager.cc:1434] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260201 08:58:34.914870 15509 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.921482 15509 tablet_bootstrap.cc:654] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.905984 15284 leader_election.cc:304] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:34.925354 15610 raft_consensus.cc:2749] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:34.932036 15512 tablet_bootstrap.cc:654] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.937983 15508 tablet_bootstrap.cc:492] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.938427 15508 ts_tablet_manager.cc:1403] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.043s user 0.031s sys 0.008s
I20260201 08:58:34.940698 15509 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.941179 15509 ts_tablet_manager.cc:1403] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.010s
I20260201 08:58:34.940923 15508 raft_consensus.cc:359] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.941555 15508 raft_consensus.cc:385] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.941839 15508 raft_consensus.cc:740] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.942420 15508 consensus_queue.cc:260] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.944202 15509 raft_consensus.cc:359] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.944794 15508 ts_tablet_manager.cc:1434] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:58:34.944849 15509 raft_consensus.cc:385] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.945263 15509 raft_consensus.cc:740] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.945715 15508 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.945961 15509 consensus_queue.cc:260] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.948236 15509 ts_tablet_manager.cc:1434] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260201 08:58:34.952135 15509 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.954576 15508 tablet_bootstrap.cc:654] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.964497 15508 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:34.964627 15509 tablet_bootstrap.cc:654] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.964983 15508 ts_tablet_manager.cc:1403] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.007s
I20260201 08:58:34.967374 15508 raft_consensus.cc:359] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.968137 15508 raft_consensus.cc:385] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.968406 15508 raft_consensus.cc:740] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.969225 15508 consensus_queue.cc:260] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.971679 15508 ts_tablet_manager.cc:1434] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260201 08:58:34.972631 15508 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:34.976161 15509 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:34.976635 15509 ts_tablet_manager.cc:1403] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.003s
I20260201 08:58:34.977840 15508 tablet_bootstrap.cc:654] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:34.979070 15509 raft_consensus.cc:359] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.979749 15509 raft_consensus.cc:385] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:34.980011 15509 raft_consensus.cc:740] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:34.981249 15679 raft_consensus.cc:493] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.982523 15679 raft_consensus.cc:515] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.984642 15679 leader_election.cc:290] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:34.985893 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:34.987200 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:34.981961 15610 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260201 08:58:34.988119 15361 leader_election.cc:343] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:34.980885 15509 consensus_queue.cc:260] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.992606 15509 ts_tablet_manager.cc:1434] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260201 08:58:34.993674 15509 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:34.994515 15466 raft_consensus.cc:2468] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:34.997601 15361 leader_election.cc:304] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:34.998603 15687 raft_consensus.cc:493] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:34.998771 15679 raft_consensus.cc:2804] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:34.999222 15687 raft_consensus.cc:515] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:34.999222 15679 raft_consensus.cc:493] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.001425 15679 raft_consensus.cc:3060] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.003013 15521 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.010066 15679 raft_consensus.cc:515] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.013114 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.013322 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:35.016793 15466 raft_consensus.cc:3060] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.014798 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cde26b6b4d4157a86e3c2b67ca2d72" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:35.017617 15361 leader_election.cc:343] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.018201 15390 raft_consensus.cc:2468] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:35.020412 15433 leader_election.cc:304] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.021656 15689 raft_consensus.cc:2804] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.022022 15689 raft_consensus.cc:493] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.022348 15689 raft_consensus.cc:3060] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.015621 15509 tablet_bootstrap.cc:654] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.013810 15687 leader_election.cc:290] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.025831 15512 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.012174 15679 leader_election.cc:290] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.026819 15512 ts_tablet_manager.cc:1403] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.120s user 0.038s sys 0.027s
I20260201 08:58:35.030611 15512 raft_consensus.cc:359] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.031131 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cde26b6b4d4157a86e3c2b67ca2d72" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.033779 15689 raft_consensus.cc:515] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.031991 15521 raft_consensus.cc:493] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.035018 15521 raft_consensus.cc:515] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.036818 15521 leader_election.cc:290] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.026831 15466 raft_consensus.cc:2468] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:35.037197 15508 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:35.037804 15512 raft_consensus.cc:385] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.037832 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ddc7ec3a25a454b880657949ea0b9da" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.038601 15512 raft_consensus.cc:740] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.038904 15361 leader_election.cc:304] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
W20260201 08:58:35.039463 15286 leader_election.cc:343] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.040016 15679 raft_consensus.cc:2804] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.040513 15679 raft_consensus.cc:697] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:35.039754 15512 consensus_queue.cc:260] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.041288 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cde26b6b4d4157a86e3c2b67ca2d72" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:35.041501 15689 leader_election.cc:290] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.041198 15508 ts_tablet_manager.cc:1403] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.069s user 0.028s sys 0.026s
I20260201 08:58:35.041886 15390 raft_consensus.cc:3060] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.041529 15679 consensus_queue.cc:237] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.044790 15512 ts_tablet_manager.cc:1434] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260201 08:58:35.044816 15508 raft_consensus.cc:359] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.046834 15508 raft_consensus.cc:385] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.047104 15508 raft_consensus.cc:740] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.048048 15512 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.057134 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ddc7ec3a25a454b880657949ea0b9da" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.057641 15392 raft_consensus.cc:2468] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:35.057878 15679 raft_consensus.cc:493] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.048161 15390 raft_consensus.cc:2468] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:35.047941 15508 consensus_queue.cc:260] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:35.053136 15435 leader_election.cc:343] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.059042 15433 leader_election.cc:304] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.060177 15661 raft_consensus.cc:2804] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.060627 15508 ts_tablet_manager.cc:1434] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.019s user 0.004s sys 0.001s
I20260201 08:58:35.054656 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cde26b6b4d4157a86e3c2b67ca2d72" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.061158 15661 raft_consensus.cc:697] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:35.058300 15679 raft_consensus.cc:515] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.061524 15508 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:35.062568 15667 raft_consensus.cc:493] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.063613 15667 raft_consensus.cc:515] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.064525 15679 leader_election.cc:290] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.065644 15667 leader_election.cc:290] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.067584 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
W20260201 08:58:35.069164 15361 leader_election.cc:343] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.069305 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:35.070725 15361 leader_election.cc:343] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.063690 15661 consensus_queue.cc:237] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.071022 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.071278 15361 leader_election.cc:304] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
W20260201 08:58:35.075126 15435 leader_election.cc:343] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.074059 15667 raft_consensus.cc:2749] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:58:35.072499 15361 leader_election.cc:343] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.081279 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.082010 15466 raft_consensus.cc:2468] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:35.083213 15361 leader_election.cc:304] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:35.084429 15667 raft_consensus.cc:2804] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.084825 15667 raft_consensus.cc:493] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.085177 15667 raft_consensus.cc:3060] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.085160 15687 raft_consensus.cc:493] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.085896 15687 raft_consensus.cc:515] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.088004 15687 leader_election.cc:290] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.090912 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.091624 15390 raft_consensus.cc:2468] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:35.092941 15433 leader_election.cc:304] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.099370 15512 tablet_bootstrap.cc:654] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.102566 15284 leader_election.cc:304] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.104353 15521 raft_consensus.cc:2804] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.104799 15521 raft_consensus.cc:493] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.105145 15521 raft_consensus.cc:3060] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.107451 15661 raft_consensus.cc:493] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.107937 15661 raft_consensus.cc:515] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.095031 15687 raft_consensus.cc:2804] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.110973 15661 leader_election.cc:290] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.114512 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:35.115661 15433 leader_election.cc:343] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.115314 15509 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:35.116475 15509 ts_tablet_manager.cc:1403] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.123s user 0.034s sys 0.038s
I20260201 08:58:35.118817 15509 raft_consensus.cc:359] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.119560 15509 raft_consensus.cc:385] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.119861 15509 raft_consensus.cc:740] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.120534 15509 consensus_queue.cc:260] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.122349 15509 ts_tablet_manager.cc:1434] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:35.113375 15687 raft_consensus.cc:493] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.122678 15661 raft_consensus.cc:493] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.123292 15687 raft_consensus.cc:3060] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.126012 15509 tablet_bootstrap.cc:492] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:35.123539 15661 raft_consensus.cc:515] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.131255 15521 raft_consensus.cc:515] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.145671 15661 leader_election.cc:290] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.146369 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.146284 15661 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.146946 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:35.148236 15433 leader_election.cc:343] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.148082 15667 raft_consensus.cc:515] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.146982 15320 raft_consensus.cc:2468] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:35.153023 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
W20260201 08:58:35.154012 15361 leader_election.cc:343] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.151630 15218 catalog_manager.cc:5654] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:35.158142 15667 leader_election.cc:290] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.156941 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.163049 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.164996 15320 raft_consensus.cc:2468] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:35.161392 15521 leader_election.cc:290] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.192891 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ddc7ec3a25a454b880657949ea0b9da" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
W20260201 08:58:35.194242 15286 leader_election.cc:343] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.196713 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:35.198654 15465 raft_consensus.cc:3060] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.198969 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ddc7ec3a25a454b880657949ea0b9da" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:35.168465 15687 raft_consensus.cc:515] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.199566 15392 raft_consensus.cc:3060] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.201081 15509 tablet_bootstrap.cc:654] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.199106 15508 tablet_bootstrap.cc:654] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.201488 15661 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.205490 15667 raft_consensus.cc:493] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.206014 15667 raft_consensus.cc:515] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:35.213160 15435 leader_election.cc:343] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.213687 15435 leader_election.cc:304] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.214298 15667 leader_election.cc:290] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.214772 15435 leader_election.cc:304] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.215608 15580 raft_consensus.cc:2749] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.216176 15580 raft_consensus.cc:2804] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.216497 15580 raft_consensus.cc:493] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.216583 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.218050 15580 raft_consensus.cc:3060] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.218082 15679 raft_consensus.cc:493] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.217873 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "522cf687b901401fbb953840208dd405" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.223600 15679 raft_consensus.cc:515] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:35.224339 15361 leader_election.cc:343] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.224982 15317 raft_consensus.cc:3060] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.225999 15679 leader_election.cc:290] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.226697 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e978370deeb04e9d85cf2cc3c936672b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.227366 15318 raft_consensus.cc:2468] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:35.228397 15361 leader_election.cc:304] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:35.230554 15679 raft_consensus.cc:2804] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.230908 15679 raft_consensus.cc:493] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.231205 15679 raft_consensus.cc:3060] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.213147 15687 leader_election.cc:290] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.237134 15468 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "522cf687b901401fbb953840208dd405" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.237772 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:35.238335 15395 raft_consensus.cc:3060] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:58:35.243789 15361 consensus_peers.cc:597] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:35.248483 15395 raft_consensus.cc:2468] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:35.249715 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e978370deeb04e9d85cf2cc3c936672b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.250450 15465 raft_consensus.cc:2468] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:35.251602 15513 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.252547 15512 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.252887 15392 raft_consensus.cc:2468] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:35.252828 15580 raft_consensus.cc:515] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.229298 15216 catalog_manager.cc:5654] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:35.254004 15361 leader_election.cc:343] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.255259 15361 leader_election.cc:304] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.255172 15580 leader_election.cc:290] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.256278 15513 raft_consensus.cc:2749] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.253013 15512 ts_tablet_manager.cc:1403] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.205s user 0.019s sys 0.017s
I20260201 08:58:35.254040 15284 leader_election.cc:304] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters: e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.258924 15610 raft_consensus.cc:2804] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.259382 15610 raft_consensus.cc:697] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
W20260201 08:58:35.260077 15361 leader_election.cc:343] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.260210 15610 consensus_queue.cc:237] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.261235 15317 raft_consensus.cc:2468] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:35.260061 15512 raft_consensus.cc:359] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.262557 15512 raft_consensus.cc:385] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.262825 15512 raft_consensus.cc:740] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.263216 15433 leader_election.cc:304] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.265909 15361 leader_election.cc:304] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:35.267316 15513 raft_consensus.cc:2804] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.267772 15513 raft_consensus.cc:697] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:35.268533 15513 consensus_queue.cc:237] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.269083 15687 raft_consensus.cc:2804] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.269641 15687 raft_consensus.cc:697] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:35.270509 15687 consensus_queue.cc:237] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.276914 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.277621 15320 raft_consensus.cc:3060] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.282172 15509 tablet_bootstrap.cc:492] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:35.282735 15509 ts_tablet_manager.cc:1403] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.159s user 0.011s sys 0.001s
I20260201 08:58:35.263427 15512 consensus_queue.cc:260] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.263844 15679 raft_consensus.cc:515] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.286441 15679 leader_election.cc:290] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.288303 15512 ts_tablet_manager.cc:1434] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.030s user 0.004s sys 0.001s
I20260201 08:58:35.290385 15509 raft_consensus.cc:359] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.291424 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e978370deeb04e9d85cf2cc3c936672b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.293512 15317 raft_consensus.cc:3060] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.294505 15512 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.292479 15320 raft_consensus.cc:2468] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:35.293869 15216 catalog_manager.cc:5654] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:35.291792 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e978370deeb04e9d85cf2cc3c936672b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:35.299676 15509 raft_consensus.cc:385] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.300005 15509 raft_consensus.cc:740] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.283092 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:35.305588 15509 consensus_queue.cc:260] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.306502 15469 raft_consensus.cc:3060] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:58:35.307257 15433 leader_election.cc:343] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.303251 15213 catalog_manager.cc:5654] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:35.308576 15512 tablet_bootstrap.cc:654] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.312938 15469 raft_consensus.cc:2468] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:35.315207 15361 leader_election.cc:304] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.315632 15317 raft_consensus.cc:2468] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:35.316116 15513 raft_consensus.cc:2804] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.316576 15513 raft_consensus.cc:697] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:35.317401 15513 consensus_queue.cc:237] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.317934 15509 ts_tablet_manager.cc:1434] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.035s user 0.001s sys 0.005s
I20260201 08:58:35.318810 15509 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:35.322543 15216 catalog_manager.cc:5654] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:35.324584 15508 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:35.325045 15508 ts_tablet_manager.cc:1403] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.264s user 0.009s sys 0.019s
I20260201 08:58:35.331074 15512 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.331863 15512 ts_tablet_manager.cc:1403] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.006s
I20260201 08:58:35.333062 15435 leader_election.cc:304] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.333971 15550 raft_consensus.cc:2804] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.334458 15550 raft_consensus.cc:697] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:35.335240 15550 consensus_queue.cc:237] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.336607 15512 raft_consensus.cc:359] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.337416 15512 raft_consensus.cc:385] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.337772 15512 raft_consensus.cc:740] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.338449 15512 consensus_queue.cc:260] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.340708 15512 ts_tablet_manager.cc:1434] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.008s user 0.002s sys 0.003s
I20260201 08:58:35.341727 15512 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.348459 15512 tablet_bootstrap.cc:654] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.350049 15508 raft_consensus.cc:359] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.354945 15508 raft_consensus.cc:385] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.355268 15508 raft_consensus.cc:740] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.355875 15508 consensus_queue.cc:260] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.358072 15508 ts_tablet_manager.cc:1434] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.033s user 0.005s sys 0.001s
I20260201 08:58:35.359041 15508 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:35.359959 15512 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.360359 15512 ts_tablet_manager.cc:1403] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.007s
I20260201 08:58:35.362695 15512 raft_consensus.cc:359] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.363399 15512 raft_consensus.cc:385] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.363678 15512 raft_consensus.cc:740] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.364491 15509 tablet_bootstrap.cc:654] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.364277 15512 consensus_queue.cc:260] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.366657 15512 ts_tablet_manager.cc:1434] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:58:35.367559 15512 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.371752 15508 tablet_bootstrap.cc:654] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.373651 15512 tablet_bootstrap.cc:654] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.374570 15509 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:35.375975 15509 ts_tablet_manager.cc:1403] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.057s user 0.010s sys 0.000s
I20260201 08:58:35.378466 15509 raft_consensus.cc:359] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.379081 15509 raft_consensus.cc:385] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.379319 15509 raft_consensus.cc:740] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.380618 15509 consensus_queue.cc:260] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.386360 15509 ts_tablet_manager.cc:1434] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260201 08:58:35.387235 15509 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:35.391331 15586 raft_consensus.cc:493] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.391819 15586 raft_consensus.cc:515] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.393429 15521 raft_consensus.cc:493] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.393908 15521 raft_consensus.cc:515] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.395030 15509 tablet_bootstrap.cc:654] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.406988 15521 leader_election.cc:290] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.412129 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.414534 15586 leader_election.cc:290] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.416157 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.416576 15217 catalog_manager.cc:5654] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:35.419633 15284 leader_election.cc:343] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.420188 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.422084 15465 raft_consensus.cc:2393] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate 544080112cc84e33ae3530baadd1d0dd in this term.
I20260201 08:58:35.422132 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.422786 15469 raft_consensus.cc:2468] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:35.431325 15286 leader_election.cc:304] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.433308 15512 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.437944 15512 ts_tablet_manager.cc:1403] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.071s user 0.019s sys 0.014s
I20260201 08:58:35.437086 15508 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:35.438655 15508 ts_tablet_manager.cc:1403] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.080s user 0.016s sys 0.007s
I20260201 08:58:35.440721 15512 raft_consensus.cc:359] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.440986 15508 raft_consensus.cc:359] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.441941 15521 raft_consensus.cc:3060] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.444386 15512 raft_consensus.cc:385] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.444823 15512 raft_consensus.cc:740] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.445586 15512 consensus_queue.cc:260] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.447887 15512 ts_tablet_manager.cc:1434] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260201 08:58:35.449144 15512 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.443305 15610 raft_consensus.cc:493] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.453212 15610 raft_consensus.cc:515] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.455085 15610 leader_election.cc:290] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.450582 15521 raft_consensus.cc:2749] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.442427 15286 leader_election.cc:304] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.457006 15610 raft_consensus.cc:2804] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.457378 15610 raft_consensus.cc:493] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.457708 15610 raft_consensus.cc:3060] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.458314 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.459005 15512 tablet_bootstrap.cc:654] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.460392 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:35.462694 15284 leader_election.cc:343] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.456095 15216 catalog_manager.cc:5654] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:35.465961 15509 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:35.466398 15509 ts_tablet_manager.cc:1403] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.079s user 0.024s sys 0.023s
I20260201 08:58:35.468143 15513 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.469046 15509 raft_consensus.cc:359] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.469743 15509 raft_consensus.cc:385] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.469996 15509 raft_consensus.cc:740] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.470880 15509 consensus_queue.cc:260] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.473146 15509 ts_tablet_manager.cc:1434] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:58:35.473979 15509 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:35.450915 15508 raft_consensus.cc:385] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.478369 15667 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.479848 15509 tablet_bootstrap.cc:654] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
W20260201 08:58:35.475951 15286 leader_election.cc:343] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.489161 15286 leader_election.cc:304] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.491839 15508 raft_consensus.cc:740] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.493685 15586 raft_consensus.cc:2749] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.494325 15508 consensus_queue.cc:260] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.464749 15610 raft_consensus.cc:515] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.500732 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
W20260201 08:58:35.502359 15284 leader_election.cc:343] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.510622 15508 ts_tablet_manager.cc:1434] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.072s user 0.005s sys 0.000s
I20260201 08:58:35.511680 15508 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:35.513762 15610 leader_election.cc:290] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.516157 15509 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:35.516611 15509 ts_tablet_manager.cc:1403] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.043s user 0.016s sys 0.015s
I20260201 08:58:35.518968 15509 raft_consensus.cc:359] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.519608 15509 raft_consensus.cc:385] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.519867 15509 raft_consensus.cc:740] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.520797 15509 consensus_queue.cc:260] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.528570 15509 ts_tablet_manager.cc:1434] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260201 08:58:35.529523 15509 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:35.530882 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:35.531697 15469 raft_consensus.cc:3060] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.535408 15509 tablet_bootstrap.cc:654] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.546365 15509 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:35.546818 15509 ts_tablet_manager.cc:1403] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.007s
I20260201 08:58:35.549160 15509 raft_consensus.cc:359] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.549810 15509 raft_consensus.cc:385] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.550066 15509 raft_consensus.cc:740] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.550629 15509 consensus_queue.cc:260] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.552146 15508 tablet_bootstrap.cc:654] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.553085 15509 ts_tablet_manager.cc:1434] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260201 08:58:35.554141 15509 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:35.558887 15509 tablet_bootstrap.cc:654] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.561045 15512 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.561471 15512 ts_tablet_manager.cc:1403] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.113s user 0.038s sys 0.035s
I20260201 08:58:35.563771 15512 raft_consensus.cc:359] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.564412 15512 raft_consensus.cc:385] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.564666 15512 raft_consensus.cc:740] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.565255 15512 consensus_queue.cc:260] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.567420 15512 ts_tablet_manager.cc:1434] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:35.567431 15469 raft_consensus.cc:2468] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:35.568413 15512 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.568711 15286 leader_election.cc:304] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.570370 15610 raft_consensus.cc:2804] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.570534 15508 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:35.571064 15508 ts_tablet_manager.cc:1403] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.000s
I20260201 08:58:35.571151 15610 raft_consensus.cc:697] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:35.572129 15610 consensus_queue.cc:237] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.574452 15512 tablet_bootstrap.cc:654] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.574172 15508 raft_consensus.cc:359] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.574821 15508 raft_consensus.cc:385] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.575076 15508 raft_consensus.cc:740] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.575763 15508 consensus_queue.cc:260] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.577080 15513 raft_consensus.cc:493] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.577507 15513 raft_consensus.cc:515] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.579321 15513 leader_election.cc:290] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.581177 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.581939 15320 raft_consensus.cc:2393] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544080112cc84e33ae3530baadd1d0dd in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:35.583119 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2706b5ec373d40a9bbf0d09ab72966d9" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.584929 15361 leader_election.cc:304] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.588660 15513 raft_consensus.cc:3060] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.589644 15508 ts_tablet_manager.cc:1434] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20260201 08:58:35.590272 15509 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:35.590730 15509 ts_tablet_manager.cc:1403] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.003s
I20260201 08:58:35.593058 15509 raft_consensus.cc:359] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.593689 15509 raft_consensus.cc:385] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.593940 15509 raft_consensus.cc:740] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.594506 15509 consensus_queue.cc:260] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.595396 15512 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.595849 15512 ts_tablet_manager.cc:1403] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.014s
I20260201 08:58:35.597586 15509 ts_tablet_manager.cc:1434] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260201 08:58:35.598558 15509 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:35.598330 15512 raft_consensus.cc:359] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.598994 15512 raft_consensus.cc:385] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.599080 15508 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:35.599299 15512 raft_consensus.cc:740] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.599908 15512 consensus_queue.cc:260] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.603675 15512 ts_tablet_manager.cc:1434] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260201 08:58:35.604542 15512 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.605701 15508 tablet_bootstrap.cc:654] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.607295 15509 tablet_bootstrap.cc:654] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.607400 15689 raft_consensus.cc:493] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.607913 15689 raft_consensus.cc:515] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.610638 15689 leader_election.cc:290] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.611328 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ddc7ec3a25a454b880657949ea0b9da" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.612126 15392 raft_consensus.cc:2393] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3f02001764a476e95c2584a094fa7d6 in current term 1: Already voted for candidate 30f18d77acb94b73a5ef2abf32e480d3 in this term.
I20260201 08:58:35.613619 15216 catalog_manager.cc:5654] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:35.615223 15513 raft_consensus.cc:2749] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.616250 15512 tablet_bootstrap.cc:654] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:35.617439 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ddc7ec3a25a454b880657949ea0b9da" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.619678 15435 leader_election.cc:304] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.620905 15661 raft_consensus.cc:3060] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.633616 15550 raft_consensus.cc:493] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.634207 15550 raft_consensus.cc:515] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.636300 15550 leader_election.cc:290] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.636842 15550 consensus_queue.cc:1048] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260201 08:58:35.640417 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:35.647377 15433 leader_election.cc:343] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.658906 15521 raft_consensus.cc:493] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.659387 15521 raft_consensus.cc:515] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.660171 15320 raft_consensus.cc:3060] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.661290 15521 leader_election.cc:290] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.665977 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a39e92ebc0d4bc89814ec24579af33c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.666273 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a39e92ebc0d4bc89814ec24579af33c" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.678630 15286 leader_election.cc:304] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.679795 15521 raft_consensus.cc:2749] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.685108 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.687351 15513 raft_consensus.cc:493] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.687887 15513 raft_consensus.cc:515] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.688882 15318 raft_consensus.cc:2468] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:35.689875 15513 leader_election.cc:290] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.697413 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.698184 15469 raft_consensus.cc:2468] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:35.699214 15361 leader_election.cc:304] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.699949 15435 leader_election.cc:304] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.701038 15513 raft_consensus.cc:2804] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.701262 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.701442 15513 raft_consensus.cc:493] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.701807 15513 raft_consensus.cc:3060] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.701925 15318 raft_consensus.cc:2468] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:35.705444 15689 raft_consensus.cc:2804] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.705845 15689 raft_consensus.cc:493] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.706151 15689 raft_consensus.cc:3060] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.715405 15689 raft_consensus.cc:515] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.731365 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
W20260201 08:58:35.733403 15433 leader_election.cc:343] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.734014 15689 leader_election.cc:290] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.737936 15660 consensus_queue.cc:1048] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.722559 15513 raft_consensus.cc:515] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.740662 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.741237 15318 raft_consensus.cc:3060] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.741761 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:35.742383 15469 raft_consensus.cc:3060] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.723896 15550 raft_consensus.cc:493] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.742978 15550 raft_consensus.cc:515] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.745723 15550 leader_election.cc:290] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.745752 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.742178 15660 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.746376 15395 raft_consensus.cc:2468] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:35.747525 15433 leader_election.cc:304] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.748031 15610 raft_consensus.cc:493] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.748503 15610 raft_consensus.cc:515] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.750406 15610 leader_election.cc:290] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.723280 15661 raft_consensus.cc:2749] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.751188 15661 raft_consensus.cc:2804] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:35.751866 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:35.752007 15661 raft_consensus.cc:493] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:35.752449 15661 raft_consensus.cc:3060] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.755033 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:35.755755 15465 raft_consensus.cc:2393] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate 544080112cc84e33ae3530baadd1d0dd in this term.
I20260201 08:58:35.756956 15286 leader_election.cc:304] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:35.757668 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.758227 15317 raft_consensus.cc:3060] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.758343 15610 raft_consensus.cc:3060] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.759093 15513 leader_election.cc:290] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:35.768504 15469 raft_consensus.cc:2468] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:35.769721 15361 leader_election.cc:304] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.771598 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:35.775126 15513 raft_consensus.cc:2804] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.775954 15513 raft_consensus.cc:697] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:35.781826 15317 raft_consensus.cc:2468] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:35.777801 15513 consensus_queue.cc:237] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.787361 15660 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.793462 15508 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:35.794013 15508 ts_tablet_manager.cc:1403] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.195s user 0.045s sys 0.045s
I20260201 08:58:35.793874 15661 raft_consensus.cc:515] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.799014 15679 consensus_queue.cc:1048] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.804095 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:35.805804 15319 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:35.804684 15395 raft_consensus.cc:3060] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.816897 15610 raft_consensus.cc:2749] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:35.818666 15508 raft_consensus.cc:359] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.819425 15508 raft_consensus.cc:385] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.821171 15512 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:35.821686 15512 ts_tablet_manager.cc:1403] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.217s user 0.028s sys 0.061s
I20260201 08:58:35.821576 15679 consensus_queue.cc:1048] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:35.828897 15395 raft_consensus.cc:2468] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:35.824754 15512 raft_consensus.cc:359] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.819715 15508 raft_consensus.cc:740] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:35.830981 15433 leader_election.cc:304] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:35.831094 15512 raft_consensus.cc:385] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:35.831454 15512 raft_consensus.cc:740] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
W20260201 08:58:35.819279 15435 leader_election.cc:343] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:35.833293 15660 raft_consensus.cc:2804] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:35.834357 15660 raft_consensus.cc:697] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:35.832145 15512 consensus_queue.cc:260] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.837586 15316 raft_consensus.cc:3060] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:35.838510 15435 leader_election.cc:304] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:35.832501 15508 consensus_queue.cc:260] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.829629 15661 leader_election.cc:290] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:35.852950 15521 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:35.854660 15667 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:35.835122 15660 consensus_queue.cc:237] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:35.864405 15508 ts_tablet_manager.cc:1434] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.070s user 0.007s sys 0.001s
I20260201 08:58:35.865928 15512 ts_tablet_manager.cc:1434] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.044s user 0.007s sys 0.000s
I20260201 08:58:35.866935 15512 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:35.865314 15508 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:35.867123 15216 catalog_manager.cc:5654] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:35.858240 15661 raft_consensus.cc:2804] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
W20260201 08:58:35.877087 15435 leader_election.cc:343] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:35.894861 15758 log.cc:927] Time spent T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: Append to log took a long time: real 0.070s user 0.000s sys 0.001s
I20260201 08:58:35.896049 15318 raft_consensus.cc:2468] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:35.923194 15687 raft_consensus.cc:493] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:35.923743 15687 raft_consensus.cc:515] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.002288 15687 leader_election.cc:290] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.027113 15509 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.027676 15509 ts_tablet_manager.cc:1403] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.429s user 0.125s sys 0.123s
I20260201 08:58:36.050980 15661 raft_consensus.cc:697] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:36.067839 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:36.066511 15521 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260201 08:58:36.072019 15508 tablet_bootstrap.cc:654] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.045975 15513 raft_consensus.cc:493] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:58:36.045936 15435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:41253, user_credentials={real_user=slave}} blocked reactor thread for 172613us
W20260201 08:58:36.079342 15433 leader_election.cc:343] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:36.061496 15284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:45593, user_credentials={real_user=slave}} blocked reactor thread for 121401us
W20260201 08:58:36.091104 15361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:39459, user_credentials={real_user=slave}} blocked reactor thread for 51246.8us
I20260201 08:58:36.089324 15509 raft_consensus.cc:359] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.093056 15509 raft_consensus.cc:385] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.093355 15509 raft_consensus.cc:740] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.097447 15509 consensus_queue.cc:260] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.076131 15513 raft_consensus.cc:515] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:36.116639 15266 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:36.102615 15667 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260201 08:58:36.127460 15509 ts_tablet_manager.cc:1434] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.100s user 0.006s sys 0.003s
I20260201 08:58:36.128228 15509 tablet_bootstrap.cc:492] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:36.137887 15513 leader_election.cc:290] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.141578 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.142602 15580 raft_consensus.cc:493] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.143098 15580 raft_consensus.cc:515] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.163112 15610 raft_consensus.cc:493] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.163399 15312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.163658 15610 raft_consensus.cc:515] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.165457 15610 leader_election.cc:290] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.104072 15661 consensus_queue.cc:237] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.176527 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72a1146f3e714f4c9b68d5f668ce839c" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:36.181777 15467 raft_consensus.cc:2393] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544080112cc84e33ae3530baadd1d0dd in current term 1: Already voted for candidate 30f18d77acb94b73a5ef2abf32e480d3 in this term.
I20260201 08:58:36.185350 15361 leader_election.cc:304] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:36.187220 15773 raft_consensus.cc:3060] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.196359 15512 tablet_bootstrap.cc:654] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.199076 15580 leader_election.cc:290] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.201452 15773 raft_consensus.cc:2749] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:36.185034 15521 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260201 08:58:36.205709 15767 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260201 08:58:36.230331 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:36.231988 15391 raft_consensus.cc:2468] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:36.225373 15550 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260201 08:58:36.247460 15284 leader_election.cc:304] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:36.248411 15318 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "522cf687b901401fbb953840208dd405" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.254534 15586 raft_consensus.cc:2804] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:36.256894 15586 raft_consensus.cc:493] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:36.257251 15586 raft_consensus.cc:3060] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.261498 15509 tablet_bootstrap.cc:654] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.261930 15508 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:36.262377 15508 ts_tablet_manager.cc:1403] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.397s user 0.015s sys 0.007s
I20260201 08:58:36.256896 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:36.264846 15469 raft_consensus.cc:2468] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:36.270278 15610 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:36.273452 15586 raft_consensus.cc:515] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.285694 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:36.286275 15392 raft_consensus.cc:3060] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.287608 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "522cf687b901401fbb953840208dd405" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:36.287245 15508 raft_consensus.cc:359] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.288221 15391 raft_consensus.cc:2468] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:36.288568 15508 raft_consensus.cc:385] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.288884 15508 raft_consensus.cc:740] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.297190 15508 consensus_queue.cc:260] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.297878 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:36.298462 15467 raft_consensus.cc:3060] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.298632 15392 raft_consensus.cc:2468] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:36.299502 15508 ts_tablet_manager.cc:1434] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260201 08:58:36.304399 15508 tablet_bootstrap.cc:492] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:36.290180 15586 leader_election.cc:290] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.307744 15433 leader_election.cc:304] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:36.310498 15776 raft_consensus.cc:2804] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:36.311419 15776 raft_consensus.cc:493] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:36.311666 15776 raft_consensus.cc:3060] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.309988 15467 raft_consensus.cc:2468] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:36.331341 15509 tablet_bootstrap.cc:492] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.333669 15509 ts_tablet_manager.cc:1403] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.206s user 0.005s sys 0.007s
I20260201 08:58:36.338871 15512 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:36.339331 15512 ts_tablet_manager.cc:1403] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.473s user 0.076s sys 0.092s
I20260201 08:58:36.339865 15660 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260201 08:58:36.344285 15512 raft_consensus.cc:359] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.347636 15512 raft_consensus.cc:385] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.347867 15512 raft_consensus.cc:740] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.348412 15512 consensus_queue.cc:260] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.353392 15766 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260201 08:58:36.355901 15776 raft_consensus.cc:515] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.354177 15512 ts_tablet_manager.cc:1434] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.015s user 0.003s sys 0.003s
I20260201 08:58:36.356256 15509 raft_consensus.cc:359] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.357319 15509 raft_consensus.cc:385] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.357590 15509 raft_consensus.cc:740] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.357802 15512 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:36.358246 15509 consensus_queue.cc:260] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:36.360222 15435 leader_election.cc:343] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.360553 15435 leader_election.cc:304] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
W20260201 08:58:36.361150 15782 log.cc:927] Time spent T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260201 08:58:36.338263 15284 leader_election.cc:304] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:36.365226 15776 leader_election.cc:290] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.365672 15508 tablet_bootstrap.cc:654] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.366341 15610 raft_consensus.cc:2804] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:36.367139 15610 raft_consensus.cc:697] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:36.369444 15610 consensus_queue.cc:237] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.372164 15509 ts_tablet_manager.cc:1434] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.038s user 0.003s sys 0.003s
I20260201 08:58:36.381676 15779 raft_consensus.cc:2749] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:36.408938 15771 raft_consensus.cc:493] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.409456 15771 raft_consensus.cc:515] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.412089 15771 leader_election.cc:290] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
W20260201 08:58:36.417377 15433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:45593, user_credentials={real_user=slave}} blocked reactor thread for 55133.6us
I20260201 08:58:36.419466 15509 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
W20260201 08:58:36.421711 15435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:41253, user_credentials={real_user=slave}} blocked reactor thread for 50942.4us
I20260201 08:58:36.426771 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:36.427577 15394 raft_consensus.cc:2393] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
W20260201 08:58:36.434302 15435 leader_election.cc:343] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.438223 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "522cf687b901401fbb953840208dd405" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:36.443809 15772 raft_consensus.cc:493] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.446019 15217 catalog_manager.cc:5654] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:36.457696 15509 tablet_bootstrap.cc:654] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.449437 15512 tablet_bootstrap.cc:654] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.452663 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:36.455809 15772 raft_consensus.cc:515] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.461618 15772 leader_election.cc:290] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
W20260201 08:58:36.465000 15786 log.cc:927] Time spent T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd: Append to log took a long time: real 0.113s user 0.001s sys 0.000s
I20260201 08:58:36.457386 15390 raft_consensus.cc:3060] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.466990 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46ee294a812241f3a8153b898b24e7c4" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:36.474274 15433 leader_election.cc:343] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.480957 15512 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:36.481437 15512 ts_tablet_manager.cc:1403] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.124s user 0.019s sys 0.017s
I20260201 08:58:36.488147 15508 tablet_bootstrap.cc:492] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:36.488619 15508 ts_tablet_manager.cc:1403] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.184s user 0.007s sys 0.002s
I20260201 08:58:36.490041 15390 raft_consensus.cc:2468] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:36.491384 15433 leader_election.cc:304] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:36.492328 15512 raft_consensus.cc:359] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.492957 15313 raft_consensus.cc:3060] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.493144 15512 raft_consensus.cc:385] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.493578 15512 raft_consensus.cc:740] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.494200 15512 consensus_queue.cc:260] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.494413 15550 raft_consensus.cc:2804] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:36.497262 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "522cf687b901401fbb953840208dd405" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:36.497944 15317 raft_consensus.cc:3060] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.501820 15508 raft_consensus.cc:359] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.502610 15508 raft_consensus.cc:385] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.502874 15508 raft_consensus.cc:740] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.501199 15550 raft_consensus.cc:697] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:36.509209 15509 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.509680 15509 ts_tablet_manager.cc:1403] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.137s user 0.016s sys 0.019s
I20260201 08:58:36.510190 15512 ts_tablet_manager.cc:1434] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260201 08:58:36.511091 15512 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:36.511348 15772 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:36.509644 15550 consensus_queue.cc:237] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.517190 15312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46ee294a812241f3a8153b898b24e7c4" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.508721 15508 consensus_queue.cc:260] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.522378 15216 catalog_manager.cc:5654] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:36.526201 15216 catalog_manager.cc:5654] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:36.524694 15317 raft_consensus.cc:2468] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:36.535709 15508 ts_tablet_manager.cc:1434] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.047s user 0.007s sys 0.000s
I20260201 08:58:36.536669 15508 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
W20260201 08:58:36.554627 15435 leader_election.cc:343] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.555204 15435 leader_election.cc:304] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:36.555222 15509 raft_consensus.cc:359] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.556041 15509 raft_consensus.cc:385] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.556313 15509 raft_consensus.cc:740] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.556492 15580 raft_consensus.cc:2749] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:36.554606 15772 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260201 08:58:36.556972 15509 consensus_queue.cc:260] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.561594 15509 ts_tablet_manager.cc:1434] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.052s user 0.023s sys 0.017s
I20260201 08:58:36.562505 15509 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:36.562887 15512 tablet_bootstrap.cc:654] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.565778 15284 leader_election.cc:304] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:36.567831 15771 raft_consensus.cc:2749] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:36.598330 15508 tablet_bootstrap.cc:654] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.616981 15512 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:36.617445 15512 ts_tablet_manager.cc:1403] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.107s user 0.020s sys 0.021s
W20260201 08:58:36.617641 15433 consensus_peers.cc:597] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:36.625799 15509 tablet_bootstrap.cc:654] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.628453 15508 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:36.629829 15508 ts_tablet_manager.cc:1403] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.093s user 0.014s sys 0.006s
I20260201 08:58:36.634177 15217 catalog_manager.cc:5654] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:36.637380 15512 raft_consensus.cc:359] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.651235 15512 raft_consensus.cc:385] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.651561 15512 raft_consensus.cc:740] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.654343 15508 raft_consensus.cc:359] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.658358 15512 consensus_queue.cc:260] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.660591 15512 ts_tablet_manager.cc:1434] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
I20260201 08:58:36.661466 15512 tablet_bootstrap.cc:492] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:36.655055 15508 raft_consensus.cc:385] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.663064 15508 raft_consensus.cc:740] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.663769 15508 consensus_queue.cc:260] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.671710 15508 ts_tablet_manager.cc:1434] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.042s user 0.004s sys 0.001s
I20260201 08:58:36.672633 15508 tablet_bootstrap.cc:492] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:36.682034 15512 tablet_bootstrap.cc:654] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.684362 15508 tablet_bootstrap.cc:654] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.691474 15509 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.691999 15509 ts_tablet_manager.cc:1403] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.130s user 0.020s sys 0.020s
I20260201 08:58:36.694551 15509 raft_consensus.cc:359] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.695287 15509 raft_consensus.cc:385] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.695566 15509 raft_consensus.cc:740] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.696290 15509 consensus_queue.cc:260] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.706310 15509 ts_tablet_manager.cc:1434] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.014s user 0.008s sys 0.000s
I20260201 08:58:36.708324 15509 tablet_bootstrap.cc:492] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:36.719871 15509 tablet_bootstrap.cc:654] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.725188 15767 raft_consensus.cc:493] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.725741 15767 raft_consensus.cc:515] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.727596 15767 leader_election.cc:290] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.730343 15312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:36.731743 15361 leader_election.cc:343] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.732606 15509 tablet_bootstrap.cc:492] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.733590 15509 ts_tablet_manager.cc:1403] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.025s user 0.011s sys 0.007s
I20260201 08:58:36.733469 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:36.733726 15512 tablet_bootstrap.cc:492] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:36.734221 15512 ts_tablet_manager.cc:1403] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.073s user 0.011s sys 0.003s
I20260201 08:58:36.734781 15508 tablet_bootstrap.cc:492] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:36.735198 15508 ts_tablet_manager.cc:1403] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.063s user 0.025s sys 0.026s
I20260201 08:58:36.736049 15509 raft_consensus.cc:359] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.736707 15509 raft_consensus.cc:385] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.736429 15512 raft_consensus.cc:359] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.737027 15509 raft_consensus.cc:740] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.737119 15512 raft_consensus.cc:385] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.737387 15512 raft_consensus.cc:740] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.737656 15509 consensus_queue.cc:260] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.737933 15512 consensus_queue.cc:260] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.739902 15509 ts_tablet_manager.cc:1434] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:58:36.740680 15509 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:36.734138 15467 raft_consensus.cc:2468] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:36.742506 15361 leader_election.cc:304] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:36.743479 15769 raft_consensus.cc:2804] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:36.743817 15769 raft_consensus.cc:493] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:36.744143 15769 raft_consensus.cc:3060] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.747555 15767 raft_consensus.cc:493] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.748015 15767 raft_consensus.cc:515] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.749780 15767 leader_election.cc:290] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.750025 15512 ts_tablet_manager.cc:1434] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260201 08:58:36.752745 15509 tablet_bootstrap.cc:654] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.752780 15508 raft_consensus.cc:359] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.753568 15508 raft_consensus.cc:385] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.753814 15508 raft_consensus.cc:740] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.754179 15312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46ee294a812241f3a8153b898b24e7c4" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.756021 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46ee294a812241f3a8153b898b24e7c4" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:36.754864 15508 consensus_queue.cc:260] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.754786 15312 raft_consensus.cc:2468] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:36.757778 15508 ts_tablet_manager.cc:1434] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.022s user 0.002s sys 0.005s
I20260201 08:58:36.756579 15467 raft_consensus.cc:2468] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:36.758678 15508 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:36.759569 15512 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:36.763480 15361 leader_election.cc:304] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:36.765174 15767 raft_consensus.cc:2804] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:36.765543 15767 raft_consensus.cc:493] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:36.765903 15767 raft_consensus.cc:3060] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.769306 15508 tablet_bootstrap.cc:654] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.772006 15509 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.772444 15509 ts_tablet_manager.cc:1403] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.001s
I20260201 08:58:36.772924 15580 raft_consensus.cc:493] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.774679 15580 raft_consensus.cc:515] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.777236 15550 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:36.778846 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:36.780112 15433 leader_election.cc:343] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.765396 15769 raft_consensus.cc:515] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.783542 15580 leader_election.cc:290] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.783601 15509 raft_consensus.cc:359] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.784498 15509 raft_consensus.cc:385] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.784807 15509 raft_consensus.cc:740] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.785540 15509 consensus_queue.cc:260] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.787861 15509 ts_tablet_manager.cc:1434] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.015s user 0.002s sys 0.004s
I20260201 08:58:36.788904 15509 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:36.790416 15512 tablet_bootstrap.cc:654] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.793996 15769 leader_election.cc:290] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.780021 15767 raft_consensus.cc:515] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.796053 15509 tablet_bootstrap.cc:654] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.796073 15767 leader_election.cc:290] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.800338 15508 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:36.800889 15508 ts_tablet_manager.cc:1403] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.042s user 0.012s sys 0.015s
I20260201 08:58:36.803406 15508 raft_consensus.cc:359] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.804085 15508 raft_consensus.cc:385] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.804060 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:36.804519 15508 raft_consensus.cc:740] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.804704 15467 raft_consensus.cc:3060] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.805469 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:36.805236 15508 consensus_queue.cc:260] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.807986 15508 ts_tablet_manager.cc:1434] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260201 08:58:36.808970 15508 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:36.813438 15467 raft_consensus.cc:2468] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:36.820514 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46ee294a812241f3a8153b898b24e7c4" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:36.821118 15316 raft_consensus.cc:3060] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.821979 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.822499 15313 raft_consensus.cc:2468] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:36.823474 15512 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:36.823902 15512 ts_tablet_manager.cc:1403] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.065s user 0.017s sys 0.008s
I20260201 08:58:36.814271 15509 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.826498 15509 ts_tablet_manager.cc:1403] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.038s user 0.011s sys 0.011s
I20260201 08:58:36.826675 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46ee294a812241f3a8153b898b24e7c4" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:36.826850 15512 raft_consensus.cc:359] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.827234 15467 raft_consensus.cc:3060] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.827527 15512 raft_consensus.cc:385] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.827822 15512 raft_consensus.cc:740] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.828404 15512 consensus_queue.cc:260] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.829028 15509 raft_consensus.cc:359] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.829651 15509 raft_consensus.cc:385] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.829921 15509 raft_consensus.cc:740] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.830571 15512 ts_tablet_manager.cc:1434] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260201 08:58:36.830528 15509 consensus_queue.cc:260] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.831532 15512 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:36.832340 15435 leader_election.cc:304] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:36.832998 15779 raft_consensus.cc:2804] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260201 08:58:36.819981 15361 leader_election.cc:343] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.833576 15316 raft_consensus.cc:2468] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:36.819244 15508 tablet_bootstrap.cc:654] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.834841 15509 ts_tablet_manager.cc:1434] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260201 08:58:36.837296 15361 leader_election.cc:304] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:36.841452 15509 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:36.841084 15767 raft_consensus.cc:2804] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:36.842406 15361 leader_election.cc:304] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:36.842562 15767 raft_consensus.cc:697] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:36.843276 15513 raft_consensus.cc:2804] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:36.843765 15513 raft_consensus.cc:697] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:36.843396 15767 consensus_queue.cc:237] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.844530 15513 consensus_queue.cc:237] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.836686 15779 raft_consensus.cc:493] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:36.847203 15779 raft_consensus.cc:3060] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.856096 15512 tablet_bootstrap.cc:654] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.866011 15509 tablet_bootstrap.cc:654] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:36.870920 15467 raft_consensus.cc:2468] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:36.882872 15550 raft_consensus.cc:493] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.883354 15550 raft_consensus.cc:515] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.888027 15550 leader_election.cc:290] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.889178 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:36.890558 15433 leader_election.cc:343] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.884465 15779 raft_consensus.cc:515] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.892103 15610 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:36.902611 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.903244 15316 raft_consensus.cc:2468] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:36.904300 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:36.904829 15313 raft_consensus.cc:3060] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.905624 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:36.906515 15580 raft_consensus.cc:493] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.907032 15580 raft_consensus.cc:515] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:36.908571 15433 leader_election.cc:343] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.900164 15766 raft_consensus.cc:493] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.909256 15766 raft_consensus.cc:515] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.909987 15580 leader_election.cc:290] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.911048 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a071c31ac54253b3abf1a4dd962735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:36.903964 15779 leader_election.cc:290] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.912889 15435 leader_election.cc:304] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:36.923097 15779 raft_consensus.cc:2804] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:36.923504 15779 raft_consensus.cc:493] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:36.920846 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a071c31ac54253b3abf1a4dd962735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.911062 15766 leader_election.cc:290] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:36.921602 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:36.923820 15779 raft_consensus.cc:3060] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.924916 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:36.918908 15390 raft_consensus.cc:2468] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:36.931447 15313 raft_consensus.cc:2468] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:36.931529 15361 leader_election.cc:304] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:36.931191 15433 leader_election.cc:304] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:36.934780 15550 raft_consensus.cc:2804] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:36.935201 15550 raft_consensus.cc:493] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:36.934345 15766 raft_consensus.cc:2749] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:36.935496 15550 raft_consensus.cc:3060] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:58:36.939323 15435 leader_election.cc:343] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.940344 15435 leader_election.cc:304] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:36.948642 15509 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:36.948593 15779 raft_consensus.cc:515] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.949218 15509 ts_tablet_manager.cc:1403] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.108s user 0.018s sys 0.017s
I20260201 08:58:36.949298 15508 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:36.949797 15508 ts_tablet_manager.cc:1403] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.141s user 0.013s sys 0.004s
I20260201 08:58:36.951781 15216 catalog_manager.cc:5654] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:36.952916 15216 catalog_manager.cc:5654] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:36.946326 15772 raft_consensus.cc:2804] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:36.956377 15550 raft_consensus.cc:515] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.963258 15550 leader_election.cc:290] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.965906 15772 raft_consensus.cc:697] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:36.966761 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a071c31ac54253b3abf1a4dd962735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:36.967092 15772 consensus_queue.cc:237] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.964586 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a071c31ac54253b3abf1a4dd962735" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:36.968012 15390 raft_consensus.cc:3060] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.969745 15509 raft_consensus.cc:359] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.970458 15509 raft_consensus.cc:385] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.970770 15509 raft_consensus.cc:740] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.971203 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:36.972101 15508 raft_consensus.cc:359] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.972724 15508 raft_consensus.cc:385] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:36.973006 15509 consensus_queue.cc:260] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:36.974277 15433 leader_election.cc:343] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.973003 15508 raft_consensus.cc:740] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:36.975083 15508 consensus_queue.cc:260] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:36.977272 15508 ts_tablet_manager.cc:1434] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260201 08:58:36.977485 15521 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:36.979327 15508 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:36.983605 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:36.978204 15509 ts_tablet_manager.cc:1434] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.029s user 0.005s sys 0.000s
I20260201 08:58:36.984205 15313 raft_consensus.cc:3060] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:36.984964 15509 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:36.990754 15509 tablet_bootstrap.cc:654] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
W20260201 08:58:36.990805 15435 leader_election.cc:343] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:36.968681 15779 leader_election.cc:290] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:36.997603 15779 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:36.998284 15766 raft_consensus.cc:493] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:36.980067 15512 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.001101 15512 ts_tablet_manager.cc:1403] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.170s user 0.023s sys 0.026s
I20260201 08:58:36.998814 15766 raft_consensus.cc:515] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.005715 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.005878 15766 leader_election.cc:290] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.005934 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:37.012624 15361 leader_election.cc:343] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.014604 15508 tablet_bootstrap.cc:654] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.014119 15390 raft_consensus.cc:2468] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:37.006354 15466 raft_consensus.cc:2468] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:37.016456 15433 leader_election.cc:304] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.017295 15361 leader_election.cc:304] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.021852 15660 raft_consensus.cc:2804] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.022403 15660 raft_consensus.cc:697] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:37.023231 15660 consensus_queue.cc:237] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.030223 15779 raft_consensus.cc:493] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.036923 15512 raft_consensus.cc:359] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.037643 15512 raft_consensus.cc:385] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.010731 15313 raft_consensus.cc:2468] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:37.037917 15512 raft_consensus.cc:740] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.038228 15766 raft_consensus.cc:2804] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.043125 15512 consensus_queue.cc:260] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.044606 15435 leader_election.cc:304] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.030789 15779 raft_consensus.cc:515] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.047834 15550 raft_consensus.cc:2804] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.046463 15766 raft_consensus.cc:493] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.051445 15766 raft_consensus.cc:3060] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.052479 15779 leader_election.cc:290] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.054612 15512 ts_tablet_manager.cc:1434] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.053s user 0.006s sys 0.001s
I20260201 08:58:37.055519 15512 tablet_bootstrap.cc:492] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.062420 15550 raft_consensus.cc:697] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:37.065500 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.065840 15508 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.066330 15508 ts_tablet_manager.cc:1403] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.087s user 0.017s sys 0.000s
I20260201 08:58:37.062724 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.068827 15508 raft_consensus.cc:359] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.069423 15508 raft_consensus.cc:385] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.070164 15508 raft_consensus.cc:740] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.070755 15508 consensus_queue.cc:260] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:37.070900 15435 leader_election.cc:343] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.069481 15217 catalog_manager.cc:5654] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
W20260201 08:58:37.076203 15433 leader_election.cc:343] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.076681 15433 leader_election.cc:304] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.063167 15550 consensus_queue.cc:237] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.087256 15508 ts_tablet_manager.cc:1434] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.021s user 0.002s sys 0.004s
I20260201 08:58:37.088138 15508 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.082206 15660 raft_consensus.cc:493] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.089962 15660 raft_consensus.cc:515] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.091747 15580 raft_consensus.cc:2749] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.091845 15660 leader_election.cc:290] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.100000 15509 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.100456 15509 ts_tablet_manager.cc:1403] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.116s user 0.014s sys 0.007s
I20260201 08:58:37.106117 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.111104 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.112352 15766 raft_consensus.cc:515] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:37.113942 15433 leader_election.cc:343] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.116824 15512 tablet_bootstrap.cc:654] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.121574 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:37.122124 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:37.117941 15823 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260201 08:58:37.122772 15466 raft_consensus.cc:3060] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.119185 15766 leader_election.cc:290] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.124181 15508 tablet_bootstrap.cc:654] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.124287 15509 raft_consensus.cc:359] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.125101 15509 raft_consensus.cc:385] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.125379 15509 raft_consensus.cc:740] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
W20260201 08:58:37.125113 15361 leader_election.cc:343] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.134418 15466 raft_consensus.cc:2468] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:37.125896 15509 consensus_queue.cc:260] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.135514 15361 leader_election.cc:304] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.136248 15766 raft_consensus.cc:2804] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.136677 15766 raft_consensus.cc:697] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:37.137477 15509 ts_tablet_manager.cc:1434] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260201 08:58:37.137447 15766 consensus_queue.cc:237] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.138406 15509 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
W20260201 08:58:37.137526 15435 leader_election.cc:343] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.140045 15435 leader_election.cc:304] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.140656 15826 raft_consensus.cc:2749] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.135332 15512 tablet_bootstrap.cc:492] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.142546 15512 ts_tablet_manager.cc:1403] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.004s
I20260201 08:58:37.145491 15509 tablet_bootstrap.cc:654] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.163899 15509 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.164331 15509 ts_tablet_manager.cc:1403] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.006s
I20260201 08:58:37.166417 15512 raft_consensus.cc:359] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.167321 15512 raft_consensus.cc:385] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.167593 15512 raft_consensus.cc:740] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.168196 15512 consensus_queue.cc:260] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.168970 15218 catalog_manager.cc:5654] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:37.170300 15512 ts_tablet_manager.cc:1434] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.027s user 0.004s sys 0.000s
I20260201 08:58:37.168205 15509 raft_consensus.cc:359] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.171777 15509 raft_consensus.cc:385] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.172093 15509 raft_consensus.cc:740] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.172816 15509 consensus_queue.cc:260] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.170573 15218 catalog_manager.cc:5654] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:37.174803 15392 raft_consensus.cc:3060] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.175477 15509 ts_tablet_manager.cc:1434] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260201 08:58:37.176430 15509 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:37.181959 15509 tablet_bootstrap.cc:654] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.171200 15512 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.193111 15512 tablet_bootstrap.cc:654] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.193511 15508 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.193969 15508 ts_tablet_manager.cc:1403] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.106s user 0.013s sys 0.002s
I20260201 08:58:37.198433 15508 raft_consensus.cc:359] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.199229 15508 raft_consensus.cc:385] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.199496 15508 raft_consensus.cc:740] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.200129 15508 consensus_queue.cc:260] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.202847 15508 ts_tablet_manager.cc:1434] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260201 08:58:37.203797 15508 tablet_bootstrap.cc:492] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.204020 15512 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.203370 15217 catalog_manager.cc:5654] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:37.204885 15512 ts_tablet_manager.cc:1403] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.034s user 0.014s sys 0.002s
I20260201 08:58:37.211078 15508 tablet_bootstrap.cc:654] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.213424 15512 raft_consensus.cc:359] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.214195 15512 raft_consensus.cc:385] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.214460 15512 raft_consensus.cc:740] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.215400 15766 raft_consensus.cc:493] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.215876 15766 raft_consensus.cc:515] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.217862 15766 leader_election.cc:290] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.220227 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.220382 15521 raft_consensus.cc:493] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.219926 15512 consensus_queue.cc:260] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.220886 15521 raft_consensus.cc:515] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.222476 15512 ts_tablet_manager.cc:1434] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260201 08:58:37.222561 15521 leader_election.cc:290] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.223438 15512 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.225798 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.226486 15465 raft_consensus.cc:2468] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:37.227840 15361 leader_election.cc:304] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:37.228899 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.229660 15466 raft_consensus.cc:2393] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate 544080112cc84e33ae3530baadd1d0dd in this term.
W20260201 08:58:37.232509 15361 leader_election.cc:343] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.236711 15766 raft_consensus.cc:2804] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.250793 15761 consensus_queue.cc:1048] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 08:58:37.251225 15266 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:37.255043 15766 raft_consensus.cc:493] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.232411 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.257867 15766 raft_consensus.cc:3060] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.263191 15284 leader_election.cc:304] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:37.264187 15521 raft_consensus.cc:3060] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.270552 15521 raft_consensus.cc:2749] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.277693 15761 consensus_queue.cc:1048] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.279183 15509 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.279721 15509 ts_tablet_manager.cc:1403] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.103s user 0.016s sys 0.036s
I20260201 08:58:37.279872 15766 raft_consensus.cc:515] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.282497 15766 leader_election.cc:290] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.282702 15508 tablet_bootstrap.cc:492] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.283174 15508 ts_tablet_manager.cc:1403] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.080s user 0.012s sys 0.010s
I20260201 08:58:37.283600 15766 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.284416 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:37.285058 15509 raft_consensus.cc:359] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.285607 15509 raft_consensus.cc:385] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.285807 15509 raft_consensus.cc:740] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.285929 15508 raft_consensus.cc:359] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.286271 15509 consensus_queue.cc:260] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.286573 15508 raft_consensus.cc:385] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.286425 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:37.286870 15508 raft_consensus.cc:740] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.287052 15465 raft_consensus.cc:3060] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.287504 15508 consensus_queue.cc:260] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.288287 15509 ts_tablet_manager.cc:1434] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260201 08:58:37.289889 15512 tablet_bootstrap.cc:654] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.290565 15508 ts_tablet_manager.cc:1434] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260201 08:58:37.291148 15826 raft_consensus.cc:493] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.291610 15508 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.291580 15826 raft_consensus.cc:515] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.293818 15826 leader_election.cc:290] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.300173 15509 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
W20260201 08:58:37.296670 15361 leader_election.cc:343] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.316882 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.322794 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:37.328289 15435 leader_election.cc:343] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.328444 15390 raft_consensus.cc:2468] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:37.331758 15433 leader_election.cc:304] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.332350 15550 raft_consensus.cc:2804] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.332679 15550 raft_consensus.cc:493] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.333001 15550 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.333763 15512 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.334290 15512 ts_tablet_manager.cc:1403] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.111s user 0.018s sys 0.022s
I20260201 08:58:37.357668 15767 raft_consensus.cc:493] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.358244 15767 raft_consensus.cc:515] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.360034 15761 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.370371 15465 raft_consensus.cc:2468] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:37.371500 15550 raft_consensus.cc:515] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.372589 15509 tablet_bootstrap.cc:654] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.373112 15512 raft_consensus.cc:359] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.373821 15512 raft_consensus.cc:385] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.374159 15512 raft_consensus.cc:740] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.374858 15512 consensus_queue.cc:260] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.375476 15767 leader_election.cc:290] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.377169 15512 ts_tablet_manager.cc:1434] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.043s user 0.005s sys 0.016s
I20260201 08:58:37.377372 15361 leader_election.cc:304] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.378196 15512 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.379083 15761 raft_consensus.cc:2804] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.379639 15761 raft_consensus.cc:697] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:37.382688 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.380405 15761 consensus_queue.cc:237] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.385106 15509 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.385552 15509 ts_tablet_manager.cc:1403] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.086s user 0.012s sys 0.001s
I20260201 08:58:37.386982 15512 tablet_bootstrap.cc:654] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.387843 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:37.387998 15509 raft_consensus.cc:359] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.388653 15509 raft_consensus.cc:385] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.388955 15509 raft_consensus.cc:740] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
W20260201 08:58:37.389115 15435 leader_election.cc:343] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.389636 15509 consensus_queue.cc:260] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.391674 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.392473 15313 raft_consensus.cc:2393] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 544080112cc84e33ae3530baadd1d0dd in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:37.392419 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:37.393080 15392 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.398257 15361 leader_election.cc:304] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:37.399401 15392 raft_consensus.cc:2468] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:37.399740 15508 tablet_bootstrap.cc:654] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.400573 15433 leader_election.cc:304] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.400772 15767 raft_consensus.cc:3060] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.401315 15826 raft_consensus.cc:2804] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.401798 15826 raft_consensus.cc:697] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:37.402506 15550 leader_election.cc:290] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.402523 15826 consensus_queue.cc:237] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.409904 15512 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.410529 15512 ts_tablet_manager.cc:1403] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.002s
I20260201 08:58:37.411986 15610 raft_consensus.cc:493] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.412459 15610 raft_consensus.cc:515] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.413884 15512 raft_consensus.cc:359] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.415653 15610 leader_election.cc:290] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.415956 15512 raft_consensus.cc:385] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.417095 15512 raft_consensus.cc:740] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.416632 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a071c31ac54253b3abf1a4dd962735" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.434476 15216 catalog_manager.cc:5654] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:37.411547 15509 ts_tablet_manager.cc:1434] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.026s user 0.016s sys 0.000s
I20260201 08:58:37.425029 15761 raft_consensus.cc:493] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.426019 15610 raft_consensus.cc:493] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.436712 15610 raft_consensus.cc:515] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.437466 15509 tablet_bootstrap.cc:492] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:37.438692 15767 raft_consensus.cc:2749] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.429987 15823 consensus_queue.cc:1048] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.416425 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2a071c31ac54253b3abf1a4dd962735" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.442322 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.443142 15465 raft_consensus.cc:2393] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate 544080112cc84e33ae3530baadd1d0dd in this term.
I20260201 08:58:37.445829 15512 consensus_queue.cc:260] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.453951 15550 raft_consensus.cc:493] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.445454 15392 raft_consensus.cc:2393] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:37.454509 15550 raft_consensus.cc:515] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.456509 15550 leader_election.cc:290] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.438612 15610 leader_election.cc:290] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.459940 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.467936 15284 leader_election.cc:304] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
W20260201 08:58:37.469201 15435 leader_election.cc:343] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.458618 15390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.472451 15284 leader_election.cc:304] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:37.473204 15521 raft_consensus.cc:3060] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.474097 15610 raft_consensus.cc:3060] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.448271 15761 raft_consensus.cc:515] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.486214 15512 ts_tablet_manager.cc:1434] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
I20260201 08:58:37.487236 15512 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.487409 15521 raft_consensus.cc:2749] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.486506 15216 catalog_manager.cc:5654] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:37.488157 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.493876 15509 tablet_bootstrap.cc:654] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.495033 15610 raft_consensus.cc:2749] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.495537 15508 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.496582 15761 leader_election.cc:290] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.498821 15508 ts_tablet_manager.cc:1403] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.207s user 0.018s sys 0.022s
W20260201 08:58:37.504045 15433 leader_election.cc:343] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.504992 15433 leader_election.cc:304] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.506242 15580 raft_consensus.cc:2749] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.510612 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.511219 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.511274 15823 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260201 08:58:37.511869 15361 leader_election.cc:343] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:58:37.513217 15361 leader_election.cc:343] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.513592 15361 leader_election.cc:304] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:37.510563 15508 raft_consensus.cc:359] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.515249 15508 raft_consensus.cc:385] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.515436 15508 raft_consensus.cc:740] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.514904 15767 raft_consensus.cc:2749] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.516072 15508 consensus_queue.cc:260] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.517321 15826 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.520092 15508 ts_tablet_manager.cc:1434] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260201 08:58:37.521024 15508 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.522315 15512 tablet_bootstrap.cc:654] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.526424 15508 tablet_bootstrap.cc:654] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.527015 15509 tablet_bootstrap.cc:492] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.529387 15772 consensus_queue.cc:1048] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.528962 15509 ts_tablet_manager.cc:1403] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.092s user 0.013s sys 0.001s
I20260201 08:58:37.533177 15509 raft_consensus.cc:359] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.535701 15509 raft_consensus.cc:385] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.535969 15509 raft_consensus.cc:740] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.536551 15509 consensus_queue.cc:260] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.547068 15509 ts_tablet_manager.cc:1434] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260201 08:58:37.548025 15509 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:37.550611 15508 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.551141 15508 ts_tablet_manager.cc:1403] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.001s
I20260201 08:58:37.581862 15509 tablet_bootstrap.cc:654] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.585397 15512 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.585979 15512 ts_tablet_manager.cc:1403] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.099s user 0.018s sys 0.023s
I20260201 08:58:37.566622 15667 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260201 08:58:37.587762 15394 raft_consensus.cc:3060] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.588433 15508 raft_consensus.cc:359] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.589128 15508 raft_consensus.cc:385] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.589382 15508 raft_consensus.cc:740] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.589984 15508 consensus_queue.cc:260] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.592093 15508 ts_tablet_manager.cc:1434] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.041s user 0.003s sys 0.000s
I20260201 08:58:37.594488 15823 raft_consensus.cc:493] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.595047 15823 raft_consensus.cc:515] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.596997 15823 leader_election.cc:290] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.600497 15508 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.601939 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:37.603636 15435 leader_election.cc:343] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.607273 15512 raft_consensus.cc:359] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.607754 15512 raft_consensus.cc:385] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.607960 15512 raft_consensus.cc:740] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.608804 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.609323 15512 consensus_queue.cc:260] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:37.611850 15433 leader_election.cc:343] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.612008 15512 ts_tablet_manager.cc:1434] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.026s user 0.003s sys 0.001s
I20260201 08:58:37.612272 15433 leader_election.cc:304] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.612848 15512 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.614677 15823 raft_consensus.cc:2749] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.624287 15509 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.624706 15509 ts_tablet_manager.cc:1403] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.077s user 0.013s sys 0.005s
I20260201 08:58:37.625566 15317 raft_consensus.cc:3060] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.631848 15823 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.635066 15772 raft_consensus.cc:493] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.635525 15772 raft_consensus.cc:515] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.637369 15772 leader_election.cc:290] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.638321 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.638352 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.639220 15512 tablet_bootstrap.cc:654] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.639041 15393 raft_consensus.cc:2468] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:37.644609 15508 tablet_bootstrap.cc:654] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
W20260201 08:58:37.647578 15435 leader_election.cc:343] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.650305 15433 leader_election.cc:304] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.651105 15771 raft_consensus.cc:493] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.651575 15771 raft_consensus.cc:515] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.652415 15509 raft_consensus.cc:359] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.653028 15823 raft_consensus.cc:2804] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.653163 15509 raft_consensus.cc:385] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.653541 15823 raft_consensus.cc:493] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.653610 15509 raft_consensus.cc:740] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.653964 15823 raft_consensus.cc:3060] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.654676 15509 consensus_queue.cc:260] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.655462 15771 leader_election.cc:290] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.656701 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.656947 15509 ts_tablet_manager.cc:1434] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260201 08:58:37.658624 15509 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:37.661391 15761 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.670732 15508 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.672253 15508 ts_tablet_manager.cc:1403] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.074s user 0.013s sys 0.001s
I20260201 08:58:37.674387 15580 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.678133 15508 raft_consensus.cc:359] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.684909 15508 raft_consensus.cc:385] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.689118 15508 raft_consensus.cc:740] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.657078 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.684234 15509 tablet_bootstrap.cc:654] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.693588 15284 leader_election.cc:304] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:37.695731 15610 raft_consensus.cc:2749] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:58:37.694509 15508 consensus_queue.cc:260] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.700100 15508 ts_tablet_manager.cc:1434] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260201 08:58:37.703533 15508 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.709385 15512 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.710078 15512 ts_tablet_manager.cc:1403] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.097s user 0.014s sys 0.009s
I20260201 08:58:37.712527 15512 raft_consensus.cc:359] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.714141 15512 raft_consensus.cc:385] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.714460 15512 raft_consensus.cc:740] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.720103 15512 consensus_queue.cc:260] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.722523 15512 ts_tablet_manager.cc:1434] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.012s user 0.003s sys 0.001s
I20260201 08:58:37.723456 15512 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.726327 15509 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.728652 15509 ts_tablet_manager.cc:1403] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.005s
I20260201 08:58:37.717469 15508 tablet_bootstrap.cc:654] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.731995 15509 raft_consensus.cc:359] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.735118 15509 raft_consensus.cc:385] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.735458 15509 raft_consensus.cc:740] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.736097 15509 consensus_queue.cc:260] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.740342 15509 ts_tablet_manager.cc:1434] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.011s user 0.004s sys 0.001s
I20260201 08:58:37.742574 15509 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:37.742451 15667 raft_consensus.cc:493] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.742971 15667 raft_consensus.cc:515] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.744824 15667 leader_election.cc:290] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.746227 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.746240 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.746932 15466 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:37.747004 15317 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:37.748023 15509 tablet_bootstrap.cc:654] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.748188 15361 leader_election.cc:304] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:37.748944 15667 raft_consensus.cc:2804] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.749369 15667 raft_consensus.cc:493] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.749790 15667 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.750584 15771 raft_consensus.cc:493] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.751051 15771 raft_consensus.cc:515] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.753213 15512 tablet_bootstrap.cc:654] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.753746 15771 leader_election.cc:290] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.755352 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:37.756520 15284 leader_election.cc:343] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.756762 15667 raft_consensus.cc:515] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.758077 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.758507 15508 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.758659 15465 raft_consensus.cc:2468] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:37.758956 15508 ts_tablet_manager.cc:1403] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.000s
I20260201 08:58:37.759833 15286 leader_election.cc:304] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.760010 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:37.760500 15521 raft_consensus.cc:2804] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.760557 15317 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.760882 15521 raft_consensus.cc:493] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.761247 15521 raft_consensus.cc:3060] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.761333 15508 raft_consensus.cc:359] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.761989 15508 raft_consensus.cc:385] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.762246 15508 raft_consensus.cc:740] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.762923 15508 consensus_queue.cc:260] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.765072 15508 ts_tablet_manager.cc:1434] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260201 08:58:37.765864 15508 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.767139 15521 raft_consensus.cc:515] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.756911 15823 raft_consensus.cc:515] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.769498 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:37.770097 15394 raft_consensus.cc:3060] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.771763 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:37.772452 15521 leader_election.cc:290] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.772846 15512 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.773299 15512 ts_tablet_manager.cc:1403] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.003s
I20260201 08:58:37.774250 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:37.774788 15393 raft_consensus.cc:3060] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.777091 15761 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.777276 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:37.777828 15465 raft_consensus.cc:3060] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.777878 15394 raft_consensus.cc:2468] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:37.783828 15393 raft_consensus.cc:2468] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:37.784644 15508 tablet_bootstrap.cc:654] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.784965 15433 leader_election.cc:304] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:37.781268 15512 raft_consensus.cc:359] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.785961 15512 raft_consensus.cc:385] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.786047 15826 raft_consensus.cc:2804] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.786257 15512 raft_consensus.cc:740] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.786572 15826 raft_consensus.cc:697] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:37.786290 15823 leader_election.cc:290] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.786876 15512 consensus_queue.cc:260] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.787366 15826 consensus_queue.cc:237] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.789008 15465 raft_consensus.cc:2468] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:37.791764 15509 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.792210 15509 ts_tablet_manager.cc:1403] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.007s
I20260201 08:58:37.792302 15284 leader_election.cc:304] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
W20260201 08:58:37.794174 15435 leader_election.cc:343] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.794574 15509 raft_consensus.cc:359] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.797887 15509 raft_consensus.cc:385] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.798184 15509 raft_consensus.cc:740] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.798281 15521 raft_consensus.cc:2804] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.798838 15521 raft_consensus.cc:697] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:37.799108 15512 ts_tablet_manager.cc:1434] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260201 08:58:37.800026 15512 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.798862 15509 consensus_queue.cc:260] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:58:37.800938 15435 consensus_peers.cc:597] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:37.799677 15521 consensus_queue.cc:237] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.802867 15509 ts_tablet_manager.cc:1434] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
I20260201 08:58:37.803709 15509 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:37.803612 15317 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:37.814384 15508 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.814919 15508 ts_tablet_manager.cc:1403] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.000s
I20260201 08:58:37.819554 15361 leader_election.cc:304] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:37.821173 15513 raft_consensus.cc:2804] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.821647 15513 raft_consensus.cc:697] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:37.822422 15513 consensus_queue.cc:237] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.823453 15508 raft_consensus.cc:359] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.831879 15508 raft_consensus.cc:385] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.825330 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:37.832190 15508 raft_consensus.cc:740] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.832466 15465 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.832804 15508 consensus_queue.cc:260] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.836997 15508 ts_tablet_manager.cc:1434] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.022s user 0.006s sys 0.002s
I20260201 08:58:37.837905 15508 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.829500 15218 catalog_manager.cc:5654] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:37.839736 15766 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.823311 15512 tablet_bootstrap.cc:654] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.819223 15667 leader_election.cc:290] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.824414 15509 tablet_bootstrap.cc:654] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.841328 15465 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:37.849697 15823 raft_consensus.cc:493] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.850195 15823 raft_consensus.cc:515] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.851086 15508 tablet_bootstrap.cc:654] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.853736 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:37.855126 15433 leader_election.cc:343] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.857386 15823 leader_election.cc:290] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.860311 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:37.862789 15435 leader_election.cc:343] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.863232 15435 leader_election.cc:304] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.863925 15826 raft_consensus.cc:2749] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.865746 15508 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:37.866688 15508 ts_tablet_manager.cc:1403] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.000s
I20260201 08:58:37.872061 15508 raft_consensus.cc:359] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.872802 15508 raft_consensus.cc:385] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.873152 15508 raft_consensus.cc:740] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.873880 15508 consensus_queue.cc:260] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.877017 15509 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.877480 15509 ts_tablet_manager.cc:1403] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.012s
I20260201 08:58:37.877918 15218 catalog_manager.cc:5654] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:37.879747 15509 raft_consensus.cc:359] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.880389 15509 raft_consensus.cc:385] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.880628 15509 raft_consensus.cc:740] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.885070 15509 consensus_queue.cc:260] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.887075 15667 raft_consensus.cc:493] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.887131 15509 ts_tablet_manager.cc:1434] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260201 08:58:37.888258 15509 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:37.887557 15667 raft_consensus.cc:515] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.889302 15512 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:37.889981 15667 leader_election.cc:290] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.892607 15512 ts_tablet_manager.cc:1403] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.093s user 0.018s sys 0.006s
I20260201 08:58:37.890584 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11b460db7c0c4e2a8c257d149e4d4111" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.891592 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11b460db7c0c4e2a8c257d149e4d4111" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.893512 15465 raft_consensus.cc:2468] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:37.891947 15216 catalog_manager.cc:5654] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:37.895320 15512 raft_consensus.cc:359] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.895969 15512 raft_consensus.cc:385] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:37.896220 15512 raft_consensus.cc:740] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:37.896157 15361 leader_election.cc:304] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:37.896938 15667 raft_consensus.cc:2804] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.892143 15508 ts_tablet_manager.cc:1434] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260201 08:58:37.897675 15667 raft_consensus.cc:493] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.898108 15667 raft_consensus.cc:3060] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:58:37.897007 15361 leader_election.cc:343] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.896911 15512 consensus_queue.cc:260] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.900425 15512 ts_tablet_manager.cc:1434] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:58:37.898308 15508 tablet_bootstrap.cc:492] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:37.906996 15512 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:37.907124 15508 tablet_bootstrap.cc:654] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.910152 15667 raft_consensus.cc:515] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.912154 15667 leader_election.cc:290] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.913054 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11b460db7c0c4e2a8c257d149e4d4111" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
W20260201 08:58:37.914311 15361 leader_election.cc:343] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.914451 15521 raft_consensus.cc:493] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.914865 15521 raft_consensus.cc:515] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.918627 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.919447 15394 raft_consensus.cc:2393] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate e3f02001764a476e95c2584a094fa7d6 in this term.
I20260201 08:58:37.920356 15521 leader_election.cc:290] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:37.921597 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:37.923022 15286 leader_election.cc:304] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:37.923956 15521 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.931139 15826 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:37.934638 15509 tablet_bootstrap.cc:654] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.936180 15512 tablet_bootstrap.cc:654] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:37.924734 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11b460db7c0c4e2a8c257d149e4d4111" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:37.939707 15521 raft_consensus.cc:2749] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.941834 15823 raft_consensus.cc:493] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.949060 15823 raft_consensus.cc:515] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.951299 15823 leader_election.cc:290] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:37.952803 15467 raft_consensus.cc:3060] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.959441 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
W20260201 08:58:37.960964 15435 leader_election.cc:343] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.962399 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
W20260201 08:58:37.964015 15433 leader_election.cc:343] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.964442 15433 leader_election.cc:304] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:37.965806 15826 raft_consensus.cc:2749] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:37.956099 15823 raft_consensus.cc:493] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:37.967509 15823 raft_consensus.cc:515] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.970350 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:37.970870 15467 raft_consensus.cc:2468] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:37.972018 15361 leader_election.cc:304] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
W20260201 08:58:37.972568 15435 leader_election.cc:343] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:37.972784 15667 raft_consensus.cc:2804] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:37.973289 15667 raft_consensus.cc:697] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:37.974099 15667 consensus_queue.cc:237] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:37.975836 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:37.976433 15392 raft_consensus.cc:2468] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:37.988912 15433 leader_election.cc:304] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:37.990571 15826 raft_consensus.cc:2804] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:37.991078 15826 raft_consensus.cc:493] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:37.991394 15826 raft_consensus.cc:3060] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:37.997817 15509 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:37.998333 15509 ts_tablet_manager.cc:1403] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.110s user 0.012s sys 0.001s
I20260201 08:58:37.973989 15823 leader_election.cc:290] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:38.004778 15521 raft_consensus.cc:493] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.005343 15521 raft_consensus.cc:515] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.009481 15521 leader_election.cc:290] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.011052 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:38.011718 15467 raft_consensus.cc:2468] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:38.012804 15286 leader_election.cc:304] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.013530 15217 catalog_manager.cc:5654] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:38.016636 15826 raft_consensus.cc:515] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.016942 15771 raft_consensus.cc:2804] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:38.026700 15771 raft_consensus.cc:493] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:38.027050 15771 raft_consensus.cc:3060] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.029121 15826 leader_election.cc:290] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:38.017729 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:38.023787 15521 raft_consensus.cc:493] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.032014 15521 raft_consensus.cc:515] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.031950 15394 raft_consensus.cc:2468] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:38.025089 15509 raft_consensus.cc:359] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.034567 15509 raft_consensus.cc:385] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.034868 15509 raft_consensus.cc:740] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.035501 15509 consensus_queue.cc:260] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.016975 15508 tablet_bootstrap.cc:492] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:38.037302 15508 ts_tablet_manager.cc:1403] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.139s user 0.035s sys 0.057s
I20260201 08:58:38.039412 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:38.040041 15467 raft_consensus.cc:2468] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 0.
I20260201 08:58:38.042774 15286 leader_election.cc:304] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.043222 15509 ts_tablet_manager.cc:1434] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.045s user 0.007s sys 0.000s
I20260201 08:58:38.043540 15610 raft_consensus.cc:2804] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:38.043905 15610 raft_consensus.cc:493] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:38.043869 15508 raft_consensus.cc:359] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.044441 15610 raft_consensus.cc:3060] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.044555 15508 raft_consensus.cc:385] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.044843 15508 raft_consensus.cc:740] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.045446 15508 consensus_queue.cc:260] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.046706 15771 raft_consensus.cc:515] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.049556 15771 leader_election.cc:290] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.051403 15509 tablet_bootstrap.cc:492] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:38.052330 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:38.052919 15465 raft_consensus.cc:3060] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.055305 15521 leader_election.cc:290] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.056833 15509 tablet_bootstrap.cc:654] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.026309 15512 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.059648 15508 ts_tablet_manager.cc:1434] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260201 08:58:38.063768 15512 ts_tablet_manager.cc:1403] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.157s user 0.019s sys 0.013s
I20260201 08:58:38.065604 15508 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:38.064831 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:38.061550 15465 raft_consensus.cc:2468] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:38.061767 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:38.070411 15286 leader_election.cc:304] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.057158 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:38.071159 15394 raft_consensus.cc:3060] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.069290 15395 raft_consensus.cc:3060] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.072209 15879 raft_consensus.cc:2804] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:38.072705 15879 raft_consensus.cc:697] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:38.073827 15879 consensus_queue.cc:237] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.075466 15508 tablet_bootstrap.cc:654] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.078329 15395 raft_consensus.cc:2468] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:38.063741 15610 raft_consensus.cc:515] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.080917 15610 leader_election.cc:290] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
W20260201 08:58:38.081739 15284 leader_election.cc:343] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.083597 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:38.084200 15467 raft_consensus.cc:3060] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.084563 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:38.086879 15512 raft_consensus.cc:359] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.098181 15512 raft_consensus.cc:385] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.098574 15512 raft_consensus.cc:740] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.095292 15467 raft_consensus.cc:2468] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 1.
I20260201 08:58:38.095448 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:38.099241 15512 consensus_queue.cc:260] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.090528 15509 tablet_bootstrap.cc:492] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
W20260201 08:58:38.097458 15435 leader_election.cc:343] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.101022 15509 ts_tablet_manager.cc:1403] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.050s user 0.012s sys 0.001s
W20260201 08:58:38.102583 15284 leader_election.cc:343] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.103104 15286 leader_election.cc:304] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters: 544080112cc84e33ae3530baadd1d0dd
I20260201 08:58:38.109163 15610 raft_consensus.cc:2804] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:38.109616 15610 raft_consensus.cc:697] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:38.110314 15610 consensus_queue.cc:237] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.111495 15394 raft_consensus.cc:2468] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:38.112679 15433 leader_election.cc:304] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:38.113511 15826 raft_consensus.cc:2804] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:38.114328 15826 raft_consensus.cc:697] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:38.115212 15826 consensus_queue.cc:237] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.121541 15509 raft_consensus.cc:359] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.122310 15509 raft_consensus.cc:385] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.122563 15509 raft_consensus.cc:740] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.123147 15509 consensus_queue.cc:260] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.124701 15508 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:38.125190 15508 ts_tablet_manager.cc:1403] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.020s
I20260201 08:58:38.125480 15509 ts_tablet_manager.cc:1434] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260201 08:58:38.126451 15509 tablet_bootstrap.cc:492] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6: Bootstrap starting.
I20260201 08:58:38.120184 15512 ts_tablet_manager.cc:1434] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.055s user 0.003s sys 0.002s
I20260201 08:58:38.127696 15512 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:38.130936 15508 raft_consensus.cc:359] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.131662 15508 raft_consensus.cc:385] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.131948 15508 raft_consensus.cc:740] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.132733 15509 tablet_bootstrap.cc:654] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.132541 15508 consensus_queue.cc:260] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.134644 15508 ts_tablet_manager.cc:1434] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.009s user 0.004s sys 0.001s
I20260201 08:58:38.138312 15512 tablet_bootstrap.cc:654] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.138258 15508 tablet_bootstrap.cc:492] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:38.143072 15217 catalog_manager.cc:5654] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:38.148636 15508 tablet_bootstrap.cc:654] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.169538 15216 catalog_manager.cc:5654] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:38.181993 15509 tablet_bootstrap.cc:492] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6: No bootstrap required, opened a new log
I20260201 08:58:38.182550 15509 ts_tablet_manager.cc:1403] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6: Time spent bootstrapping tablet: real 0.056s user 0.021s sys 0.007s
I20260201 08:58:38.187873 15508 tablet_bootstrap.cc:492] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:38.189158 15508 ts_tablet_manager.cc:1403] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.051s user 0.015s sys 0.009s
I20260201 08:58:38.189601 15509 raft_consensus.cc:359] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.190935 15509 raft_consensus.cc:385] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.193763 15509 raft_consensus.cc:740] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.195468 15509 consensus_queue.cc:260] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.197649 15509 ts_tablet_manager.cc:1434] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260201 08:58:38.193110 15508 raft_consensus.cc:359] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.198451 15508 raft_consensus.cc:385] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.198540 15610 raft_consensus.cc:493] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.198796 15508 raft_consensus.cc:740] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.198962 15610 raft_consensus.cc:515] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.199517 15508 consensus_queue.cc:260] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.200826 15216 catalog_manager.cc:5654] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:38.201936 15508 ts_tablet_manager.cc:1434] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260201 08:58:38.202826 15508 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:38.203064 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11b460db7c0c4e2a8c257d149e4d4111" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:38.203802 15467 raft_consensus.cc:2393] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30f18d77acb94b73a5ef2abf32e480d3 in current term 1: Already voted for candidate 544080112cc84e33ae3530baadd1d0dd in this term.
I20260201 08:58:38.200702 15610 leader_election.cc:290] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.207613 15512 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.208024 15512 ts_tablet_manager.cc:1403] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.081s user 0.018s sys 0.018s
I20260201 08:58:38.208357 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11b460db7c0c4e2a8c257d149e4d4111" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:38.209281 15508 tablet_bootstrap.cc:654] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.211447 15823 raft_consensus.cc:493] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.211890 15823 raft_consensus.cc:515] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.212146 15284 leader_election.cc:304] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:38.213840 15823 leader_election.cc:290] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:38.215072 15610 raft_consensus.cc:3060] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.219209 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:38.221151 15508 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:38.221630 15508 ts_tablet_manager.cc:1403] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.008s
W20260201 08:58:38.223140 15435 leader_election.cc:343] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.224177 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:38.224769 15395 raft_consensus.cc:2468] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:38.225452 15508 raft_consensus.cc:359] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.210892 15512 raft_consensus.cc:359] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.226243 15433 leader_election.cc:304] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:38.226575 15512 raft_consensus.cc:385] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.226979 15512 raft_consensus.cc:740] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.227269 15826 raft_consensus.cc:2804] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:38.227638 15826 raft_consensus.cc:493] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:38.225831 15610 raft_consensus.cc:2749] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:38.228001 15826 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.227739 15512 consensus_queue.cc:260] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.230372 15512 ts_tablet_manager.cc:1434] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260201 08:58:38.226251 15508 raft_consensus.cc:385] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.231057 15508 raft_consensus.cc:740] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.231763 15513 raft_consensus.cc:493] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.231702 15508 consensus_queue.cc:260] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.232194 15513 raft_consensus.cc:515] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.233758 15513 leader_election.cc:290] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.237825 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:38.238307 15512 tablet_bootstrap.cc:492] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
W20260201 08:58:38.239215 15361 leader_election.cc:343] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.241714 15508 ts_tablet_manager.cc:1434] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.020s user 0.001s sys 0.004s
I20260201 08:58:38.242573 15508 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:38.242463 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:38.242311 15826 raft_consensus.cc:515] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.243109 15465 raft_consensus.cc:2468] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:38.244478 15826 leader_election.cc:290] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:38.246107 15395 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:38.246623 15395 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.247565 15823 consensus_queue.cc:1048] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.246614 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:38.263572 15361 leader_election.cc:304] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:38.264528 15395 raft_consensus.cc:2468] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
W20260201 08:58:38.265487 15435 leader_election.cc:343] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.271692 15433 leader_election.cc:304] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:38.267716 15508 tablet_bootstrap.cc:654] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.268290 15667 raft_consensus.cc:2804] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:38.273157 15667 raft_consensus.cc:493] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:38.273515 15667 raft_consensus.cc:3060] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.279736 15580 raft_consensus.cc:2804] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:38.280225 15580 raft_consensus.cc:697] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:38.280923 15580 consensus_queue.cc:237] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.281437 15508 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:38.281888 15508 ts_tablet_manager.cc:1403] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.039s user 0.010s sys 0.000s
I20260201 08:58:38.269187 15767 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.269670 15512 tablet_bootstrap.cc:654] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.284129 15508 raft_consensus.cc:359] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.284732 15508 raft_consensus.cc:385] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.285043 15508 raft_consensus.cc:740] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.285902 15508 consensus_queue.cc:260] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.288005 15508 ts_tablet_manager.cc:1434] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:58:38.288779 15508 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: Bootstrap starting.
I20260201 08:58:38.294178 15508 tablet_bootstrap.cc:654] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: Neither blocks nor log segments found. Creating new log.
W20260201 08:58:38.295418 15435 consensus_peers.cc:597] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:38.311782 15508 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: No bootstrap required, opened a new log
I20260201 08:58:38.312271 15508 ts_tablet_manager.cc:1403] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.003s
I20260201 08:58:38.314339 15512 tablet_bootstrap.cc:492] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.314989 15512 ts_tablet_manager.cc:1403] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.007s
I20260201 08:58:38.314780 15508 raft_consensus.cc:359] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.315482 15508 raft_consensus.cc:385] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.315755 15508 raft_consensus.cc:740] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.316409 15508 consensus_queue.cc:260] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.318527 15508 ts_tablet_manager.cc:1434] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260201 08:58:38.298025 15667 raft_consensus.cc:515] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.324910 15667 leader_election.cc:290] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.327296 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:38.327766 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:38.327919 15767 raft_consensus.cc:493] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.328317 15467 raft_consensus.cc:3060] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.328698 15767 raft_consensus.cc:515] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.329339 15512 raft_consensus.cc:359] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.330022 15512 raft_consensus.cc:385] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.330452 15512 raft_consensus.cc:740] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
W20260201 08:58:38.334398 15361 leader_election.cc:343] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.335119 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ad471d716964e0ca752941d6b983477" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:38.330567 15767 leader_election.cc:290] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.330986 15667 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.332532 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ad471d716964e0ca752941d6b983477" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:38.335929 15465 raft_consensus.cc:2468] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:38.336306 15317 raft_consensus.cc:2468] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:38.333715 15512 consensus_queue.cc:260] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.337262 15361 leader_election.cc:304] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.344734 15667 raft_consensus.cc:2804] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:38.345163 15667 raft_consensus.cc:493] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:38.345479 15667 raft_consensus.cc:3060] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.346719 15610 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.346482 15823 raft_consensus.cc:493] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.358148 15823 raft_consensus.cc:515] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.339524 15512 ts_tablet_manager.cc:1434] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
W20260201 08:58:38.338554 15266 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:58:38.367254 15512 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:38.367393 15667 raft_consensus.cc:515] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.367923 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:38.368796 15317 raft_consensus.cc:2468] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:38.365643 15218 catalog_manager.cc:5654] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:38.369807 15435 leader_election.cc:304] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.370575 15580 raft_consensus.cc:2804] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:38.342170 15467 raft_consensus.cc:2468] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:38.371016 15667 leader_election.cc:290] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.372012 15361 leader_election.cc:304] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters: 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:38.372386 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ad471d716964e0ca752941d6b983477" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:38.371832 15823 leader_election.cc:290] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:38.373432 15580 raft_consensus.cc:493] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:38.374454 15580 raft_consensus.cc:3060] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.373051 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:38.372987 15465 raft_consensus.cc:3060] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.375173 15394 raft_consensus.cc:2468] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 0.
I20260201 08:58:38.376793 15667 raft_consensus.cc:2804] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:38.409318 15667 raft_consensus.cc:697] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:38.410270 15667 consensus_queue.cc:237] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.422374 15580 raft_consensus.cc:515] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.427580 15580 leader_election.cc:290] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:38.376585 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ad471d716964e0ca752941d6b983477" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:38.429391 15512 tablet_bootstrap.cc:654] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.433878 15465 raft_consensus.cc:2468] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:38.440198 15361 leader_election.cc:304] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.443271 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:38.443488 15667 raft_consensus.cc:2804] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:38.443878 15394 raft_consensus.cc:3060] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.444144 15667 raft_consensus.cc:697] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:38.442726 15317 raft_consensus.cc:3060] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.456278 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:38.458531 15216 catalog_manager.cc:5654] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:38.465016 15879 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.466342 15313 raft_consensus.cc:3060] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.466689 15766 raft_consensus.cc:493] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.467163 15766 raft_consensus.cc:515] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.477692 15766 leader_election.cc:290] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.478408 15313 raft_consensus.cc:2468] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:38.479105 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:38.479741 15466 raft_consensus.cc:2468] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 0.
I20260201 08:58:38.480932 15361 leader_election.cc:304] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.481844 15767 raft_consensus.cc:2804] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:58:38.482211 15767 raft_consensus.cc:493] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:58:38.482594 15767 raft_consensus.cc:3060] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.483822 15394 raft_consensus.cc:2468] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 1.
I20260201 08:58:38.482092 15320 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3" is_pre_election: true
I20260201 08:58:38.485267 15433 leader_election.cc:304] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:58:38.493345 15879 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.498767 15826 raft_consensus.cc:2804] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election won for term 1
W20260201 08:58:38.496201 15361 leader_election.cc:343] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:58:38.499368 15826 raft_consensus.cc:697] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:38.502239 15667 consensus_queue.cc:237] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.500252 15826 consensus_queue.cc:237] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.517721 15512 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.518229 15512 ts_tablet_manager.cc:1403] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.151s user 0.021s sys 0.030s
I20260201 08:58:38.519564 15879 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.520658 15512 raft_consensus.cc:359] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.521366 15512 raft_consensus.cc:385] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.521657 15512 raft_consensus.cc:740] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.524068 15512 consensus_queue.cc:260] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.526340 15512 ts_tablet_manager.cc:1434] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20260201 08:58:38.527372 15512 tablet_bootstrap.cc:492] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:38.530463 15766 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.533389 15512 tablet_bootstrap.cc:654] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.538348 15394 raft_consensus.cc:3060] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.546609 15898 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.547302 15512 tablet_bootstrap.cc:492] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.547827 15512 ts_tablet_manager.cc:1403] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.021s user 0.012s sys 0.004s
I20260201 08:58:38.550417 15512 raft_consensus.cc:359] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.551110 15512 raft_consensus.cc:385] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.551383 15512 raft_consensus.cc:740] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.552173 15512 consensus_queue.cc:260] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.554409 15512 ts_tablet_manager.cc:1434] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260201 08:58:38.555588 15512 tablet_bootstrap.cc:492] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:38.556232 15879 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.561816 15879 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.562493 15512 tablet_bootstrap.cc:654] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.583595 15767 raft_consensus.cc:515] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.594491 15512 tablet_bootstrap.cc:492] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.596750 15512 ts_tablet_manager.cc:1403] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.041s user 0.010s sys 0.008s
I20260201 08:58:38.598222 15766 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.600170 15512 raft_consensus.cc:359] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.600878 15512 raft_consensus.cc:385] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.601163 15512 raft_consensus.cc:740] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.601788 15317 raft_consensus.cc:2468] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:38.601738 15512 consensus_queue.cc:260] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.603955 15512 ts_tablet_manager.cc:1434] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260201 08:58:38.604944 15512 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
W20260201 08:58:38.611315 15435 consensus_peers.cc:597] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:38.611524 15512 tablet_bootstrap.cc:654] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.612636 15767 leader_election.cc:290] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.614473 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:38.615077 15316 raft_consensus.cc:3060] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.617774 15512 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.618248 15512 ts_tablet_manager.cc:1403] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260201 08:58:38.622062 15316 raft_consensus.cc:2468] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:38.622462 15512 raft_consensus.cc:359] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.623582 15512 raft_consensus.cc:385] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.623867 15512 raft_consensus.cc:740] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.624848 15361 leader_election.cc:304] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:38.625705 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:38.625914 15512 consensus_queue.cc:260] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.626353 15466 raft_consensus.cc:3060] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.626441 15667 raft_consensus.cc:2804] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:58:38.627099 15667 raft_consensus.cc:697] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:38.628099 15667 consensus_queue.cc:237] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.631151 15512 ts_tablet_manager.cc:1434] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260201 08:58:38.632129 15512 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3: Bootstrap starting.
I20260201 08:58:38.634943 15466 raft_consensus.cc:2468] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 1.
I20260201 08:58:38.638253 15512 tablet_bootstrap.cc:654] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3: Neither blocks nor log segments found. Creating new log.
I20260201 08:58:38.694514 15313 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.698135 15217 catalog_manager.cc:5654] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:38.743781 15823 consensus_queue.cc:1048] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:38.765246 15512 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3: No bootstrap required, opened a new log
I20260201 08:58:38.766120 15512 ts_tablet_manager.cc:1403] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent bootstrapping tablet: real 0.134s user 0.012s sys 0.005s
I20260201 08:58:38.770174 15512 raft_consensus.cc:359] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.771046 15512 raft_consensus.cc:385] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:58:38.771380 15512 raft_consensus.cc:740] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Initialized, Role: FOLLOWER
I20260201 08:58:38.776479 15216 catalog_manager.cc:5654] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:58:38.776885 15512 consensus_queue.cc:260] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.783694 15512 ts_tablet_manager.cc:1434] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3: Time spent starting tablet: real 0.017s user 0.009s sys 0.000s
I20260201 08:58:38.806439 15580 consensus_queue.cc:1048] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:38.828961 15218 catalog_manager.cc:5654] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:38.831646 15313 raft_consensus.cc:3060] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.840444 15766 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:38.851770 15320 raft_consensus.cc:3060] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:38.879518 15513 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:38.880767 15879 raft_consensus.cc:493] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3f02001764a476e95c2584a094fa7d6)
I20260201 08:58:38.881353 15879 raft_consensus.cc:515] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.885962 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:38.887656 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:38.888978 15879 leader_election.cc:290] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.890887 15284 leader_election.cc:304] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:38.893641 15879 raft_consensus.cc:2749] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:58:38.931421 15898 consensus_queue.cc:1048] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:58:38.942387 15898 consensus_queue.cc:1048] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:38.996093 15879 raft_consensus.cc:493] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:58:38.996531 15879 raft_consensus.cc:515] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:38.998112 15879 leader_election.cc:290] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:38.998750 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "544080112cc84e33ae3530baadd1d0dd" is_pre_election: true
I20260201 08:58:38.998934 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f02001764a476e95c2584a094fa7d6" is_pre_election: true
I20260201 08:58:39.000058 15286 leader_election.cc:304] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3; no voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6
I20260201 08:58:39.000640 15879 raft_consensus.cc:2749] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:58:39.015583 15766 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:39.029448 15313 raft_consensus.cc:3060] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:58:39.032197 15513 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:39.034431 15513 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:39.044726 15513 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:58:39.146445 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:58:39.179064 15934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:39.179105 15931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:58:39.179268 15932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:58:39.183926 14089 server_base.cc:1060] running on GCE node
I20260201 08:58:39.185271 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:58:39.185544 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:58:39.185714 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936319185697 us; error 0 us; skew 500 ppm
I20260201 08:58:39.186314 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:58:39.188796 14089 webserver.cc:492] Webserver started at http://127.13.194.68:36325/ using document root <none> and password file <none>
I20260201 08:58:39.189302 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:58:39.189503 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:58:39.189772 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:58:39.191001 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-3-root/instance:
uuid: "a87a3e28e16f46a2ae235d381d0b4520"
format_stamp: "Formatted at 2026-02-01 08:58:39 on dist-test-slave-7fnp"
I20260201 08:58:39.197897 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260201 08:58:39.201900 15939 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:39.202605 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260201 08:58:39.202901 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-3-root
uuid: "a87a3e28e16f46a2ae235d381d0b4520"
format_stamp: "Formatted at 2026-02-01 08:58:39 on dist-test-slave-7fnp"
I20260201 08:58:39.203172 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:58:39.226944 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:58:39.228579 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:58:39.230651 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:58:39.234107 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:58:39.234319 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:39.234576 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:58:39.234720 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:58:39.327724 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.68:37119
I20260201 08:58:39.327909 16001 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.68:37119 every 8 connection(s)
I20260201 08:58:39.333468 14089 auto_leader_rebalancer-test.cc:417] add a tserver: a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:39.346585 16002 heartbeater.cc:344] Connected to a master server at 127.13.194.126:35057
I20260201 08:58:39.346977 16002 heartbeater.cc:461] Registering TS with master...
I20260201 08:58:39.347728 16002 heartbeater.cc:507] Master 127.13.194.126:35057 requested a full tablet report, sending...
I20260201 08:58:39.349458 15216 ts_manager.cc:194] Registered new tserver with Master: a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119)
I20260201 08:58:39.350943 15216 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50890
I20260201 08:58:39.444046 15466 consensus_queue.cc:237] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:39.450517 15313 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:39.451794 15394 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:39.451822 15826 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:39.453276 15580 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:39.462353 15826 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.464167 15394 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.465047 15313 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:58:39.467463 15433 consensus_peers.cc:597] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c3675b3fa6c6432984d1f5cfd34fd873. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:39.481397 15466 consensus_queue.cc:237] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:39.484403 15217 catalog_manager.cc:5654] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:39.505529 15433 consensus_peers.cc:597] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8e27f1a110b46768ce90a7cf579c5c7. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:39.506407 15394 raft_consensus.cc:1275] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:39.507534 15313 raft_consensus.cc:1275] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:39.508778 15898 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:39.509896 15580 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:39.522682 16016 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.523728 15394 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.538720 15313 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.550616 15216 catalog_manager.cc:5654] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.567696 15313 consensus_queue.cc:237] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:39.574139 15466 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:39.575263 15392 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:39.575349 15879 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:39.576874 15521 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:39.582948 15610 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.584674 15392 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.585709 15466 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.601117 15465 consensus_queue.cc:237] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:58:39.607585 15284 consensus_peers.cc:597] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9202773444f2496c9bbc700a0b3a85f6. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:39.611630 15216 catalog_manager.cc:5654] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:39.616621 15394 raft_consensus.cc:1275] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:39.618093 15433 consensus_peers.cc:597] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 522cf687b901401fbb953840208dd405. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:39.618613 16020 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:39.619352 15313 raft_consensus.cc:1275] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:39.621064 16016 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:39.635871 15580 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.642532 15392 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.637786 15313 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:39.656116 15216 catalog_manager.cc:5654] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:39.933724 16026 ts_tablet_manager.cc:933] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:39.935673 16026 tablet_copy_client.cc:323] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:39.954597 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet c3675b3fa6c6432984d1f5cfd34fd873 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:39.955228 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet c3675b3fa6c6432984d1f5cfd34fd873 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-c3675b3fa6c6432984d1f5cfd34fd873
I20260201 08:58:39.963336 15479 tablet_copy_source_session.cc:215] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:39.969493 16026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3675b3fa6c6432984d1f5cfd34fd873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:39.989326 16026 tablet_copy_client.cc:806] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:39.989993 16026 tablet_copy_client.cc:670] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:39.991344 16029 ts_tablet_manager.cc:933] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:39.996174 16026 tablet_copy_client.cc:538] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:40.009296 16026 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:40.013255 16029 tablet_copy_client.cc:323] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:40.023185 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 9202773444f2496c9bbc700a0b3a85f6 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:40.023751 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 9202773444f2496c9bbc700a0b3a85f6 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-9202773444f2496c9bbc700a0b3a85f6
I20260201 08:58:40.029381 16032 ts_tablet_manager.cc:933] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:40.031322 15330 tablet_copy_source_session.cc:215] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:40.033527 16026 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:40.034512 16026 tablet_bootstrap.cc:492] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:40.035075 16029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9202773444f2496c9bbc700a0b3a85f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:40.035218 16026 ts_tablet_manager.cc:1403] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.008s
I20260201 08:58:40.038406 16026 raft_consensus.cc:359] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.039148 16026 raft_consensus.cc:740] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:40.039772 16026 consensus_queue.cc:260] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.042699 16002 heartbeater.cc:499] Master 127.13.194.126:35057 was elected leader, sending a full tablet report...
I20260201 08:58:40.043509 16026 ts_tablet_manager.cc:1434] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260201 08:58:40.045177 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-c3675b3fa6c6432984d1f5cfd34fd873 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:40.045655 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-c3675b3fa6c6432984d1f5cfd34fd873 on tablet c3675b3fa6c6432984d1f5cfd34fd873 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:40.050407 16032 tablet_copy_client.cc:323] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:40.052673 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet 522cf687b901401fbb953840208dd405 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:40.053185 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet 522cf687b901401fbb953840208dd405 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-522cf687b901401fbb953840208dd405
I20260201 08:58:40.059582 15479 tablet_copy_source_session.cc:215] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:40.064066 16032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522cf687b901401fbb953840208dd405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:40.065827 16029 tablet_copy_client.cc:806] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:40.066854 16029 tablet_copy_client.cc:670] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:40.070166 16029 tablet_copy_client.cc:538] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:40.078943 16029 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:40.080696 16032 tablet_copy_client.cc:806] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:40.081568 16032 tablet_copy_client.cc:670] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:40.087076 16032 tablet_copy_client.cc:538] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:40.096275 16032 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:40.099716 16029 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:40.100708 16029 tablet_bootstrap.cc:492] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:40.101523 16029 ts_tablet_manager.cc:1403] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.023s user 0.021s sys 0.000s
I20260201 08:58:40.102510 16026 ts_tablet_manager.cc:933] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:40.104133 16026 tablet_copy_client.cc:323] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:40.104532 16029 raft_consensus.cc:359] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.105387 16029 raft_consensus.cc:740] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:40.105790 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet f8e27f1a110b46768ce90a7cf579c5c7 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:40.106042 16029 consensus_queue.cc:260] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.106611 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet f8e27f1a110b46768ce90a7cf579c5c7 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-f8e27f1a110b46768ce90a7cf579c5c7
I20260201 08:58:40.110143 16029 ts_tablet_manager.cc:1434] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:58:40.111766 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-9202773444f2496c9bbc700a0b3a85f6 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:40.112208 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-9202773444f2496c9bbc700a0b3a85f6 on tablet 9202773444f2496c9bbc700a0b3a85f6 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:40.124681 15479 tablet_copy_source_session.cc:215] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:40.128815 16026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e27f1a110b46768ce90a7cf579c5c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:40.143600 16026 tablet_copy_client.cc:806] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:40.145326 16026 tablet_copy_client.cc:670] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:40.151180 16026 tablet_copy_client.cc:538] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:40.153774 16032 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:40.154456 16032 tablet_bootstrap.cc:492] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:40.155177 16032 ts_tablet_manager.cc:1403] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.059s user 0.022s sys 0.012s
I20260201 08:58:40.158006 16032 raft_consensus.cc:359] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.158979 16026 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:40.158874 16032 raft_consensus.cc:740] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:40.160708 16032 consensus_queue.cc:260] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.163151 16032 ts_tablet_manager.cc:1434] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:58:40.169353 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-522cf687b901401fbb953840208dd405 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:40.169752 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-522cf687b901401fbb953840208dd405 on tablet 522cf687b901401fbb953840208dd405 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:40.180419 16026 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:40.181291 16026 tablet_bootstrap.cc:492] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:40.181897 16026 ts_tablet_manager.cc:1403] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.004s
I20260201 08:58:40.184458 16026 raft_consensus.cc:359] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.185359 16026 raft_consensus.cc:740] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:40.185990 16026 consensus_queue.cc:260] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:40.188311 16026 ts_tablet_manager.cc:1434] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:58:40.191371 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-f8e27f1a110b46768ce90a7cf579c5c7 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:40.191784 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-f8e27f1a110b46768ce90a7cf579c5c7 on tablet f8e27f1a110b46768ce90a7cf579c5c7 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:40.344334 15977 raft_consensus.cc:1217] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:40.502228 15977 raft_consensus.cc:1217] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:40.598109 15977 raft_consensus.cc:1217] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:40.676146 15977 raft_consensus.cc:1217] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:40.851555 16020 raft_consensus.cc:1064] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:40.853713 16020 consensus_queue.cc:237] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:40.859591 15977 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:40.860296 15316 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:40.861788 15392 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:40.861760 16020 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:40.862747 15826 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:40.864059 16040 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:40.880368 15580 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.883435 15977 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.889542 15392 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.893349 15313 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.901156 15217 catalog_manager.cc:5654] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.940796 15467 consensus_queue.cc:237] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:40.948258 15977 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:40.948700 15316 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:40.950583 16040 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:40.954775 16040 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:40.958077 16040 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.959403 15313 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.977588 15977 raft_consensus.cc:2955] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.986423 15216 catalog_manager.cc:5654] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:40.990686 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c3675b3fa6c6432984d1f5cfd34fd873 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:41.013564 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet c3675b3fa6c6432984d1f5cfd34fd873 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:41.015779 16051 tablet_replica.cc:333] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:41.018448 16051 raft_consensus.cc:2243] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:41.019428 16051 raft_consensus.cc:2272] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:41.023164 16051 ts_tablet_manager.cc:1916] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:41.037642 16051 ts_tablet_manager.cc:1929] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:41.038141 16051 log.cc:1199] T c3675b3fa6c6432984d1f5cfd34fd873 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/c3675b3fa6c6432984d1f5cfd34fd873
I20260201 08:58:41.039858 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet c3675b3fa6c6432984d1f5cfd34fd873 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:41.072482 15580 raft_consensus.cc:1064] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:41.074575 15580 consensus_queue.cc:237] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:41.079753 15392 raft_consensus.cc:1275] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.080004 15313 raft_consensus.cc:1275] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.080940 16020 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:41.081388 15977 raft_consensus.cc:1275] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.082918 16020 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:41.083771 15580 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:41.098567 16020 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.100522 15392 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.108170 15320 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.120416 15977 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.118671 15216 catalog_manager.cc:5654] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.143327 15465 consensus_queue.cc:237] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:41.148655 15977 raft_consensus.cc:1275] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:41.150156 15313 raft_consensus.cc:1275] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:41.151446 16020 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:41.153344 15580 consensus_queue.cc:1048] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:41.162186 16020 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.163573 15313 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.168581 15977 raft_consensus.cc:2955] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.180275 15218 catalog_manager.cc:5654] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.181097 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 522cf687b901401fbb953840208dd405 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:41.191587 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 522cf687b901401fbb953840208dd405 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:41.192588 16051 tablet_replica.cc:333] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:41.193545 16051 raft_consensus.cc:2243] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:41.194238 16051 raft_consensus.cc:2272] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:41.201161 16051 ts_tablet_manager.cc:1916] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:41.203452 16056 raft_consensus.cc:1064] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:41.209828 16056 consensus_queue.cc:237] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:41.216850 15977 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.218166 15465 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.218457 16041 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:41.220181 16041 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:41.222920 16051 ts_tablet_manager.cc:1929] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:41.223393 16051 log.cc:1199] T 522cf687b901401fbb953840208dd405 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/522cf687b901401fbb953840208dd405
I20260201 08:58:41.224905 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 522cf687b901401fbb953840208dd405 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:41.226372 15392 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.230876 16058 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260201 08:58:41.328778 16059 log.cc:927] Time spent T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
I20260201 08:58:41.338119 15521 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.342053 15977 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.359195 15218 catalog_manager.cc:5654] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.372589 15826 raft_consensus.cc:1064] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:41.375190 15826 consensus_queue.cc:237] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:41.386093 15466 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.393426 15977 raft_consensus.cc:1275] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.395380 15392 raft_consensus.cc:1275] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.398459 15317 raft_consensus.cc:1275] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:41.403317 16040 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:41.405797 15392 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.409909 15580 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260201 08:58:41.412662 16062 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:41.432978 15317 consensus_queue.cc:237] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:41.434490 16067 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.438164 15977 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.450649 15395 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:41.454730 15977 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:41.452176 15393 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.451733 15317 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.455011 15218 catalog_manager.cc:5654] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:41.456159 16064 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:41.457965 16058 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:41.465386 16064 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.468454 15466 consensus_queue.cc:237] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:41.474946 15395 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.477749 15976 raft_consensus.cc:1275] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:41.481345 16062 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:41.488624 15977 raft_consensus.cc:2955] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.490018 15826 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.494026 15976 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.500396 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9202773444f2496c9bbc700a0b3a85f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:41.506458 15216 catalog_manager.cc:5654] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.511482 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f8e27f1a110b46768ce90a7cf579c5c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:41.518381 15394 raft_consensus.cc:1275] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:41.526844 16040 consensus_queue.cc:1048] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:41.528462 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 9202773444f2496c9bbc700a0b3a85f6 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:41.531941 15216 catalog_manager.cc:5654] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:41.537472 16070 tablet_replica.cc:333] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:41.536996 15393 raft_consensus.cc:2955] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:41.538362 16070 raft_consensus.cc:2243] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:41.539129 16070 raft_consensus.cc:2272] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:41.544588 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet f8e27f1a110b46768ce90a7cf579c5c7 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:41.557902 16070 ts_tablet_manager.cc:1916] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:41.568048 16071 tablet_replica.cc:333] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:41.568881 16071 raft_consensus.cc:2243] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:41.569448 16071 raft_consensus.cc:2272] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:41.573601 16071 ts_tablet_manager.cc:1916] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:41.575924 16070 ts_tablet_manager.cc:1929] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:41.576377 16070 log.cc:1199] T 9202773444f2496c9bbc700a0b3a85f6 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/9202773444f2496c9bbc700a0b3a85f6
I20260201 08:58:41.577926 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 9202773444f2496c9bbc700a0b3a85f6 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:41.587599 16071 ts_tablet_manager.cc:1929] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:41.588066 16071 log.cc:1199] T f8e27f1a110b46768ce90a7cf579c5c7 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/f8e27f1a110b46768ce90a7cf579c5c7
I20260201 08:58:41.589684 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet f8e27f1a110b46768ce90a7cf579c5c7 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:42.598030 15394 consensus_queue.cc:237] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:42.603431 15465 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:42.603587 15316 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:42.604527 16076 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.605672 16039 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.613183 16076 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.615607 15465 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:58:42.618927 15359 consensus_peers.cc:597] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74dd5038caeb4002a7029db349d2d5ea. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:42.615554 15316 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.629024 15216 catalog_manager.cc:5654] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:42.631251 15394 consensus_queue.cc:237] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:42.641862 15465 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:42.642163 15359 consensus_peers.cc:597] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 701bd49fcb3346a0873fe568317002e8. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:42.643270 15316 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:42.644942 16063 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.645958 16039 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.655395 16063 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.660254 15467 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.673275 15394 consensus_queue.cc:237] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:42.742393 15216 catalog_manager.cc:5654] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:42.767673 15359 consensus_peers.cc:597] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ad471d716964e0ca752941d6b983477. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:42.768608 15467 raft_consensus.cc:1275] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:42.770166 15320 raft_consensus.cc:1275] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:42.771029 16076 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.771889 16063 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.781327 15320 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.785459 16089 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.787206 15467 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.793778 15316 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.799144 15317 consensus_queue.cc:237] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:42.811558 15213 catalog_manager.cc:5654] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:58:42.836141 15284 consensus_peers.cc:597] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c11524c3a8704cfdba261441ff2bed79. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:42.838351 15467 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:42.840163 16041 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.840879 15393 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:42.842947 16064 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:42.847213 16041 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.848785 15467 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.851900 15393 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:42.866680 15213 catalog_manager.cc:5654] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:43.029742 16098 ts_tablet_manager.cc:933] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:43.032151 16098 tablet_copy_client.cc:323] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:43.043313 15405 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 74dd5038caeb4002a7029db349d2d5ea from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:43.043897 15405 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 74dd5038caeb4002a7029db349d2d5ea from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-74dd5038caeb4002a7029db349d2d5ea
I20260201 08:58:43.051254 15405 tablet_copy_source_session.cc:215] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:43.054420 16098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74dd5038caeb4002a7029db349d2d5ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:43.068578 16098 tablet_copy_client.cc:806] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:43.069165 16098 tablet_copy_client.cc:670] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:43.072891 16098 tablet_copy_client.cc:538] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:43.079499 16098 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:43.097590 16098 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:43.098485 16098 tablet_bootstrap.cc:492] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:43.099162 16098 ts_tablet_manager.cc:1403] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.009s
I20260201 08:58:43.101758 16098 raft_consensus.cc:359] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.102594 16098 raft_consensus.cc:740] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:43.103210 16098 consensus_queue.cc:260] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.110441 16098 ts_tablet_manager.cc:1434] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260201 08:58:43.112286 15405 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-74dd5038caeb4002a7029db349d2d5ea received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:43.112836 15405 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-74dd5038caeb4002a7029db349d2d5ea on tablet 74dd5038caeb4002a7029db349d2d5ea with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:43.149194 16098 ts_tablet_manager.cc:933] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:43.152729 16098 tablet_copy_client.cc:323] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:43.154110 15405 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 701bd49fcb3346a0873fe568317002e8 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:43.154620 15405 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 701bd49fcb3346a0873fe568317002e8 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-701bd49fcb3346a0873fe568317002e8
I20260201 08:58:43.160944 15405 tablet_copy_source_session.cc:215] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:43.163512 16098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701bd49fcb3346a0873fe568317002e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:43.175107 16098 tablet_copy_client.cc:806] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:43.175594 16098 tablet_copy_client.cc:670] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:43.178426 16098 tablet_copy_client.cc:538] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:43.189949 16098 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:43.208452 16098 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:43.209301 16098 tablet_bootstrap.cc:492] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:43.209896 16098 ts_tablet_manager.cc:1403] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.004s
I20260201 08:58:43.212232 16098 raft_consensus.cc:359] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.213004 16098 raft_consensus.cc:740] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:43.213613 16098 consensus_queue.cc:260] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.215410 16098 ts_tablet_manager.cc:1434] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:58:43.216967 15405 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-701bd49fcb3346a0873fe568317002e8 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:43.217357 15405 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-701bd49fcb3346a0873fe568317002e8 on tablet 701bd49fcb3346a0873fe568317002e8 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:43.249719 16098 ts_tablet_manager.cc:933] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:43.251315 16098 tablet_copy_client.cc:323] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:43.252682 15405 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 8ad471d716964e0ca752941d6b983477 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:43.253196 15405 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 8ad471d716964e0ca752941d6b983477 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-8ad471d716964e0ca752941d6b983477
I20260201 08:58:43.258659 15405 tablet_copy_source_session.cc:215] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:43.261113 16098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ad471d716964e0ca752941d6b983477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:43.270327 16106 ts_tablet_manager.cc:933] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:43.271875 16106 tablet_copy_client.cc:323] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:43.273280 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet c11524c3a8704cfdba261441ff2bed79 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:43.273833 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet c11524c3a8704cfdba261441ff2bed79 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-c11524c3a8704cfdba261441ff2bed79
I20260201 08:58:43.275563 16098 tablet_copy_client.cc:806] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:43.276087 16098 tablet_copy_client.cc:670] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:43.278959 16098 tablet_copy_client.cc:538] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:43.280257 15330 tablet_copy_source_session.cc:215] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:43.282922 16106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11524c3a8704cfdba261441ff2bed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:43.286986 16098 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:43.310258 16098 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:43.311053 16098 tablet_bootstrap.cc:492] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:43.311652 16098 ts_tablet_manager.cc:1403] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.025s user 0.009s sys 0.014s
I20260201 08:58:43.312923 16106 tablet_copy_client.cc:806] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:43.313445 16106 tablet_copy_client.cc:670] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:43.314020 16098 raft_consensus.cc:359] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.314771 16098 raft_consensus.cc:740] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:43.315321 16098 consensus_queue.cc:260] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.317245 16106 tablet_copy_client.cc:538] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:43.317492 16098 ts_tablet_manager.cc:1434] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260201 08:58:43.321105 15405 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-8ad471d716964e0ca752941d6b983477 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:43.321492 15405 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-8ad471d716964e0ca752941d6b983477 on tablet 8ad471d716964e0ca752941d6b983477 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:43.333669 16106 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:43.350072 16106 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:43.350936 16106 tablet_bootstrap.cc:492] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:43.351478 16106 ts_tablet_manager.cc:1403] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20260201 08:58:43.355017 16106 raft_consensus.cc:359] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.355839 16106 raft_consensus.cc:740] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:43.356317 16106 consensus_queue.cc:260] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:43.358525 16106 ts_tablet_manager.cc:1434] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260201 08:58:43.360194 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-c11524c3a8704cfdba261441ff2bed79 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:43.360585 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-c11524c3a8704cfdba261441ff2bed79 on tablet c11524c3a8704cfdba261441ff2bed79 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:43.649580 15976 raft_consensus.cc:1217] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:43.657553 15976 raft_consensus.cc:1217] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:43.677619 15976 raft_consensus.cc:1217] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:43.847319 15976 raft_consensus.cc:1217] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:44.121219 16064 raft_consensus.cc:1064] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:44.123116 16064 consensus_queue.cc:237] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.128711 15467 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.129678 15394 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.129933 15976 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.130057 16064 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.131317 16096 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.132829 16097 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.151544 16063 raft_consensus.cc:1064] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:44.151005 16097 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.155479 15394 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.157397 15976 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.154090 16063 consensus_queue.cc:237] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.162468 15467 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.220755 15213 catalog_manager.cc:5654] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.239290 16090 raft_consensus.cc:1064] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:44.241631 16090 consensus_queue.cc:237] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.261788 15467 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.266481 15976 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.268042 15316 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.269505 16063 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.273579 15977 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.280018 16117 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:44.286144 16120 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.287205 15465 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.296356 16076 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.302474 16076 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.304328 15320 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.309564 15317 consensus_queue.cc:237] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.322958 15975 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.324330 15466 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.325802 16064 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:44.325953 16117 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.329205 16064 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:44.334321 16097 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.339398 15466 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.342536 15977 raft_consensus.cc:2955] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.345830 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c11524c3a8704cfdba261441ff2bed79 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:44.353229 16120 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.355978 15216 catalog_manager.cc:5654] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:44.367424 15317 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.375084 15465 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.381626 15217 catalog_manager.cc:5654] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:44.389012 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet c11524c3a8704cfdba261441ff2bed79 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:44.400823 15977 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.417315 16129 tablet_replica.cc:333] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:44.419349 16076 raft_consensus.cc:1064] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:44.419893 15394 consensus_queue.cc:237] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.419771 16116 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.421836 16076 consensus_queue.cc:237] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.425736 15316 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.430307 15975 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.430821 15316 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.434664 16090 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:44.448889 16120 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.455263 15213 catalog_manager.cc:5654] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.462731 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 74dd5038caeb4002a7029db349d2d5ea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:44.461500 16129 raft_consensus.cc:2243] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:44.464087 16129 raft_consensus.cc:2272] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:44.470254 16129 ts_tablet_manager.cc:1916] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:44.472954 15976 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.475005 16063 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:44.481601 15312 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.482384 15975 raft_consensus.cc:2955] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.485919 15216 catalog_manager.cc:5654] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:44.498546 16129 ts_tablet_manager.cc:1929] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:44.499092 16129 log.cc:1199] T c11524c3a8704cfdba261441ff2bed79 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/c11524c3a8704cfdba261441ff2bed79
I20260201 08:58:44.486215 15466 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.501045 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet c11524c3a8704cfdba261441ff2bed79 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:44.502701 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 74dd5038caeb4002a7029db349d2d5ea with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:44.507944 15976 raft_consensus.cc:1275] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.510530 16132 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:44.514413 15317 raft_consensus.cc:1275] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.515895 16132 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.530648 15467 raft_consensus.cc:1275] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:44.526232 15394 consensus_queue.cc:237] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.533215 16132 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:44.537213 16133 tablet_replica.cc:333] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:44.538339 16133 raft_consensus.cc:2243] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:44.539040 16133 raft_consensus.cc:2272] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:44.546218 16133 ts_tablet_manager.cc:1916] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:44.550284 15976 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.550655 16076 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.552093 16090 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:44.554734 15317 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.561177 16116 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.566905 15976 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.568445 15466 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.572794 16120 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:44.576737 15975 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.583461 16133 ts_tablet_manager.cc:1929] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:44.583005 15466 raft_consensus.cc:2955] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.583966 16133 log.cc:1199] T 74dd5038caeb4002a7029db349d2d5ea P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/74dd5038caeb4002a7029db349d2d5ea
I20260201 08:58:44.587718 15216 catalog_manager.cc:5654] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:44.589149 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 74dd5038caeb4002a7029db349d2d5ea (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:44.592700 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 701bd49fcb3346a0873fe568317002e8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:44.611153 15217 catalog_manager.cc:5654] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.620304 15466 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.622499 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet 701bd49fcb3346a0873fe568317002e8 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:44.625831 15394 consensus_queue.cc:237] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:44.631541 15975 raft_consensus.cc:1275] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.633567 15317 raft_consensus.cc:1275] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:44.634789 16090 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:44.637666 16116 consensus_queue.cc:1048] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:44.644845 16063 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.645718 15317 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.653108 15975 raft_consensus.cc:2955] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:44.661729 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 8ad471d716964e0ca752941d6b983477 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:44.673333 16137 tablet_replica.cc:333] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:44.673146 15217 catalog_manager.cc:5654] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:44.674126 16137 raft_consensus.cc:2243] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:44.674686 16137 raft_consensus.cc:2272] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:44.676978 16137 ts_tablet_manager.cc:1916] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:44.681835 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 8ad471d716964e0ca752941d6b983477 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:44.682781 16133 tablet_replica.cc:333] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:44.683743 16133 raft_consensus.cc:2243] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:44.684381 16133 raft_consensus.cc:2272] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:44.689024 16133 ts_tablet_manager.cc:1916] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:44.700176 16137 ts_tablet_manager.cc:1929] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:44.700587 16137 log.cc:1199] T 701bd49fcb3346a0873fe568317002e8 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/701bd49fcb3346a0873fe568317002e8
I20260201 08:58:44.701851 16133 ts_tablet_manager.cc:1929] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:44.701951 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet 701bd49fcb3346a0873fe568317002e8 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:44.702405 16133 log.cc:1199] T 8ad471d716964e0ca752941d6b983477 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/8ad471d716964e0ca752941d6b983477
I20260201 08:58:44.703505 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 8ad471d716964e0ca752941d6b983477 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:45.732522 15466 consensus_queue.cc:237] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:58:45.738122 15433 consensus_peers.cc:597] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc5ab607d0114b979fafd03b2cd64b82. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:45.738550 15395 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:45.739418 15317 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:45.739909 16138 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:45.740792 16072 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:45.747403 16067 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.749421 15312 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.749987 15395 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.758971 15466 consensus_queue.cc:237] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:45.782961 15312 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:45.784518 16067 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260201 08:58:45.786608 15433 consensus_peers.cc:597] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a58e5895d1541adabbfb02b14fa2735. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:45.777143 15216 catalog_manager.cc:5654] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.792052 15395 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:45.794102 16067 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:45.800604 16142 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.802301 15312 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.807804 15395 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.820012 15395 consensus_queue.cc:237] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:45.825975 15466 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:45.832899 15359 consensus_peers.cc:597] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8085f989cb7c433b9306a89ddf9cf36b. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:45.833081 15312 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:45.833664 16063 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:45.835691 15218 catalog_manager.cc:5654] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.840251 16063 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:45.848363 16132 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.851965 15312 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.857982 15466 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.861493 15395 consensus_queue.cc:237] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:45.869508 15217 catalog_manager.cc:5654] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:45.887907 15317 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:45.889293 16132 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:45.889477 15466 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:45.892127 15359 consensus_peers.cc:597] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ad26ab3f81f457890e164908be52f74. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:45.894243 16063 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:45.909713 16155 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.912943 15317 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.914952 15466 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:45.931824 15216 catalog_manager.cc:5654] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:46.309092 16158 ts_tablet_manager.cc:933] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:46.312534 16158 tablet_copy_client.cc:323] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:46.313903 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet 3a58e5895d1541adabbfb02b14fa2735 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:46.314412 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet 3a58e5895d1541adabbfb02b14fa2735 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-3a58e5895d1541adabbfb02b14fa2735
I20260201 08:58:46.319984 15479 tablet_copy_source_session.cc:215] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:46.322736 16158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a58e5895d1541adabbfb02b14fa2735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:46.332667 16160 ts_tablet_manager.cc:933] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:46.337230 16158 tablet_copy_client.cc:806] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:46.337850 16158 tablet_copy_client.cc:670] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:46.341087 16160 tablet_copy_client.cc:323] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:46.341984 16158 tablet_copy_client.cc:538] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:46.342666 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet bc5ab607d0114b979fafd03b2cd64b82 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:46.343216 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet bc5ab607d0114b979fafd03b2cd64b82 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-bc5ab607d0114b979fafd03b2cd64b82
I20260201 08:58:46.350708 15479 tablet_copy_source_session.cc:215] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:46.352258 16158 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:46.354100 16160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5ab607d0114b979fafd03b2cd64b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:46.370072 16160 tablet_copy_client.cc:806] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:46.370580 16160 tablet_copy_client.cc:670] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:46.373672 16160 tablet_copy_client.cc:538] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:46.375958 16158 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:46.376776 16158 tablet_bootstrap.cc:492] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:46.377351 16158 ts_tablet_manager.cc:1403] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.009s
I20260201 08:58:46.380064 16158 raft_consensus.cc:359] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.380839 16158 raft_consensus.cc:740] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:46.381835 16158 consensus_queue.cc:260] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.383172 16160 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:46.407225 16158 ts_tablet_manager.cc:1434] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.030s user 0.014s sys 0.008s
I20260201 08:58:46.418190 16160 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:46.419118 16160 tablet_bootstrap.cc:492] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:46.419772 16160 ts_tablet_manager.cc:1403] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.037s user 0.013s sys 0.009s
I20260201 08:58:46.422392 16160 raft_consensus.cc:359] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.423202 16160 raft_consensus.cc:740] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:46.423781 16160 consensus_queue.cc:260] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.426343 16160 ts_tablet_manager.cc:1434] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:58:46.426343 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-3a58e5895d1541adabbfb02b14fa2735 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:46.428364 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-3a58e5895d1541adabbfb02b14fa2735 on tablet 3a58e5895d1541adabbfb02b14fa2735 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:46.432298 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-bc5ab607d0114b979fafd03b2cd64b82 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:46.432636 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-bc5ab607d0114b979fafd03b2cd64b82 on tablet bc5ab607d0114b979fafd03b2cd64b82 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:46.434538 16158 ts_tablet_manager.cc:933] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:46.439867 16160 ts_tablet_manager.cc:933] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:46.450592 16160 tablet_copy_client.cc:323] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:46.452179 15405 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 8085f989cb7c433b9306a89ddf9cf36b from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:46.452710 15405 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 8085f989cb7c433b9306a89ddf9cf36b from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-8085f989cb7c433b9306a89ddf9cf36b
I20260201 08:58:46.453751 16158 tablet_copy_client.cc:323] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:46.455117 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 7ad26ab3f81f457890e164908be52f74 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:46.455650 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 7ad26ab3f81f457890e164908be52f74 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-7ad26ab3f81f457890e164908be52f74
I20260201 08:58:46.459980 15405 tablet_copy_source_session.cc:215] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:46.463019 16160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8085f989cb7c433b9306a89ddf9cf36b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:46.464191 15404 tablet_copy_source_session.cc:215] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:46.472198 16158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ad26ab3f81f457890e164908be52f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:46.480458 16160 tablet_copy_client.cc:806] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:46.481068 16160 tablet_copy_client.cc:670] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:46.484354 16160 tablet_copy_client.cc:538] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:46.489915 16158 tablet_copy_client.cc:806] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:46.490522 16158 tablet_copy_client.cc:670] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:46.492544 16160 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:46.493711 16158 tablet_copy_client.cc:538] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:46.506803 16158 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:46.515972 16160 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:46.517131 16160 tablet_bootstrap.cc:492] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:46.517854 16160 ts_tablet_manager.cc:1403] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.025s user 0.019s sys 0.004s
I20260201 08:58:46.520589 16160 raft_consensus.cc:359] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.521447 16160 raft_consensus.cc:740] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:46.522017 16160 consensus_queue.cc:260] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.524362 16160 ts_tablet_manager.cc:1434] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:58:46.525969 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-8085f989cb7c433b9306a89ddf9cf36b received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:46.526331 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-8085f989cb7c433b9306a89ddf9cf36b on tablet 8085f989cb7c433b9306a89ddf9cf36b with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:46.532371 16158 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:46.533296 16158 tablet_bootstrap.cc:492] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:46.533954 16158 ts_tablet_manager.cc:1403] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.002s
I20260201 08:58:46.538460 16158 raft_consensus.cc:359] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.539254 16158 raft_consensus.cc:740] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:46.539817 16158 consensus_queue.cc:260] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:46.542006 16158 ts_tablet_manager.cc:1434] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260201 08:58:46.543783 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-7ad26ab3f81f457890e164908be52f74 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:46.544155 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-7ad26ab3f81f457890e164908be52f74 on tablet 7ad26ab3f81f457890e164908be52f74 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:46.762264 15975 raft_consensus.cc:1217] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:46.813283 15975 raft_consensus.cc:1217] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:46.838160 15975 raft_consensus.cc:1217] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:46.849855 15975 raft_consensus.cc:1217] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:47.181258 16138 raft_consensus.cc:1064] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:47.183331 16138 consensus_queue.cc:237] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.194218 15975 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.194269 15394 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.194689 15312 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.195924 16067 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.196715 16173 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.197753 16142 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.214388 16138 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.216143 15312 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.225608 15394 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.236184 15218 catalog_manager.cc:5654] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.243083 15975 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.270498 15465 consensus_queue.cc:237] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.280462 15975 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.280581 15394 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.281806 16067 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:47.283301 16142 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:47.289124 16067 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.291769 15393 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.296653 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet bc5ab607d0114b979fafd03b2cd64b82 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:47.304603 15216 catalog_manager.cc:5654] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:47.301352 15975 raft_consensus.cc:2955] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.322767 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet bc5ab607d0114b979fafd03b2cd64b82 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:47.324584 16181 tablet_replica.cc:333] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:47.325374 16181 raft_consensus.cc:2243] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:47.326103 16181 raft_consensus.cc:2272] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:47.329945 16181 ts_tablet_manager.cc:1916] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:47.349900 16181 ts_tablet_manager.cc:1929] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:47.350317 16181 log.cc:1199] T bc5ab607d0114b979fafd03b2cd64b82 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/bc5ab607d0114b979fafd03b2cd64b82
I20260201 08:58:47.351938 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet bc5ab607d0114b979fafd03b2cd64b82 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:47.383405 16155 raft_consensus.cc:1064] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:47.385874 16155 consensus_queue.cc:237] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.392913 15975 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.393275 15467 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.394259 16164 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.396186 16164 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.401377 15312 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.408627 16183 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:47.415817 16183 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.417796 15467 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.426134 15317 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.436178 15976 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.443150 16067 raft_consensus.cc:1064] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:47.444347 16164 raft_consensus.cc:1064] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:47.445470 16067 consensus_queue.cc:237] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.445858 15217 catalog_manager.cc:5654] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.446672 16164 consensus_queue.cc:237] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.451452 15393 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.453589 16138 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.460690 15975 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.462841 15317 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.466152 16173 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.469025 16067 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.506196 15392 consensus_queue.cc:237] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.524245 15973 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.525628 15974 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.535197 16155 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.545555 16188 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260201 08:58:47.565711 16142 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.567083 16183 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.569597 15973 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.571457 15975 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.591812 15466 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.599179 15394 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.607149 16189 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:47.610349 15213 catalog_manager.cc:5654] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:47.612273 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 8085f989cb7c433b9306a89ddf9cf36b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:47.619719 15466 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.623065 15216 catalog_manager.cc:5654] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.624039 15317 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:47.629135 16198 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.628651 15465 raft_consensus.cc:2955] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.635663 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet 8085f989cb7c433b9306a89ddf9cf36b with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:47.636592 16181 tablet_replica.cc:333] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:47.637527 16181 raft_consensus.cc:2243] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:47.638217 16181 raft_consensus.cc:2272] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:47.641798 16181 ts_tablet_manager.cc:1916] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:47.657416 16164 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:47.666669 15312 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.693907 16198 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.695082 15465 consensus_queue.cc:237] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.701373 15317 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.703801 16202 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:47.706970 15467 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.709288 15316 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.710306 16142 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.713996 15312 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.724054 15973 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.701102 15975 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.728057 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3a58e5895d1541adabbfb02b14fa2735 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:47.729841 16173 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:47.734712 15216 catalog_manager.cc:5654] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.740955 15217 catalog_manager.cc:5654] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:47.751276 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 3a58e5895d1541adabbfb02b14fa2735 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:47.755411 15975 raft_consensus.cc:2955] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.718937 16181 ts_tablet_manager.cc:1929] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:47.765450 16181 log.cc:1199] T 8085f989cb7c433b9306a89ddf9cf36b P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/8085f989cb7c433b9306a89ddf9cf36b
I20260201 08:58:47.770640 16205 tablet_replica.cc:333] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:47.773968 15394 consensus_queue.cc:237] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:47.775067 16205 raft_consensus.cc:2243] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:47.775802 16205 raft_consensus.cc:2272] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:47.778856 16205 ts_tablet_manager.cc:1916] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:47.789856 15312 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.789896 15973 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:47.791595 16164 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:47.792887 16198 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:47.799568 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet 8085f989cb7c433b9306a89ddf9cf36b (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:47.801702 16198 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.806094 15317 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.812968 16205 ts_tablet_manager.cc:1929] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:47.813360 16205 log.cc:1199] T 3a58e5895d1541adabbfb02b14fa2735 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/3a58e5895d1541adabbfb02b14fa2735
I20260201 08:58:47.814755 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 3a58e5895d1541adabbfb02b14fa2735 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:47.826567 15975 raft_consensus.cc:2955] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.836122 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 7ad26ab3f81f457890e164908be52f74 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:47.841971 15216 catalog_manager.cc:5654] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:47.853049 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ad26ab3f81f457890e164908be52f74 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:47.855868 16206 tablet_replica.cc:333] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:47.856608 16206 raft_consensus.cc:2243] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:47.857208 16206 raft_consensus.cc:2272] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:47.859903 16206 ts_tablet_manager.cc:1916] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:47.872577 16206 ts_tablet_manager.cc:1929] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:47.872941 16206 log.cc:1199] T 7ad26ab3f81f457890e164908be52f74 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/7ad26ab3f81f457890e164908be52f74
I20260201 08:58:47.874233 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 7ad26ab3f81f457890e164908be52f74 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:48.944263 15312 consensus_queue.cc:237] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:48.952872 15465 raft_consensus.cc:1275] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:48.954437 15392 raft_consensus.cc:1275] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:48.954802 16197 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:48.958386 16195 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260201 08:58:48.961536 15284 consensus_peers.cc:597] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ea6d15904e84f4db55e93adfea29377. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:48.969143 16197 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:48.973065 15392 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:48.974284 15467 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.002516 15213 catalog_manager.cc:5654] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.012149 15312 consensus_queue.cc:237] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:58:49.024039 15284 consensus_peers.cc:597] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72a1146f3e714f4c9b68d5f668ce839c. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:49.024739 15467 raft_consensus.cc:1275] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:49.025938 16195 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:49.026379 15394 raft_consensus.cc:1275] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:49.030745 16213 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:49.043483 16213 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.044962 15394 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.053333 15467 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.057858 15394 consensus_queue.cc:237] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.061610 15216 catalog_manager.cc:5654] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:58:49.066959 15359 consensus_peers.cc:597] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c37d9e5e810f4cde8bf85667cc298883. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:49.067571 15467 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:49.070210 16198 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:49.070899 15312 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:49.075703 16164 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:49.090634 16208 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.095942 15466 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.106689 15467 consensus_queue.cc:237] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.110018 15213 catalog_manager.cc:5654] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:49.120091 15316 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.130527 15394 raft_consensus.cc:1275] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:49.131089 15317 raft_consensus.cc:1275] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:49.133392 15433 consensus_peers.cc:597] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2706b5ec373d40a9bbf0d09ab72966d9. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:49.133752 16142 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260201 08:58:49.140070 16202 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:49.151055 16202 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.152225 15316 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.163662 15392 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.170099 15213 catalog_manager.cc:5654] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:49.434055 16229 ts_tablet_manager.cc:933] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:49.436264 16229 tablet_copy_client.cc:323] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:49.438109 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 72a1146f3e714f4c9b68d5f668ce839c from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:49.438597 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 72a1146f3e714f4c9b68d5f668ce839c from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-72a1146f3e714f4c9b68d5f668ce839c
I20260201 08:58:49.446839 15330 tablet_copy_source_session.cc:215] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:49.449965 16229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72a1146f3e714f4c9b68d5f668ce839c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:49.488044 16231 ts_tablet_manager.cc:933] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:49.490193 16229 tablet_copy_client.cc:806] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:49.491037 16229 tablet_copy_client.cc:670] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:49.495198 16229 tablet_copy_client.cc:538] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:49.496803 16231 tablet_copy_client.cc:323] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:49.498318 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 5ea6d15904e84f4db55e93adfea29377 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:49.498811 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 5ea6d15904e84f4db55e93adfea29377 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-5ea6d15904e84f4db55e93adfea29377
I20260201 08:58:49.505892 16229 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:49.506556 15330 tablet_copy_source_session.cc:215] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:49.509663 16231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ea6d15904e84f4db55e93adfea29377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:49.525689 16231 tablet_copy_client.cc:806] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:49.526233 16231 tablet_copy_client.cc:670] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:49.529775 16231 tablet_copy_client.cc:538] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:49.538841 16231 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:49.548116 16229 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:49.548995 16229 tablet_bootstrap.cc:492] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:49.549744 16229 ts_tablet_manager.cc:1403] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.044s user 0.020s sys 0.008s
I20260201 08:58:49.552794 16229 raft_consensus.cc:359] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.553776 16229 raft_consensus.cc:740] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:49.554517 16229 consensus_queue.cc:260] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.557749 16229 ts_tablet_manager.cc:1434] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260201 08:58:49.559404 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-72a1146f3e714f4c9b68d5f668ce839c received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:49.559876 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-72a1146f3e714f4c9b68d5f668ce839c on tablet 72a1146f3e714f4c9b68d5f668ce839c with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:49.562538 16231 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:49.564587 16231 tablet_bootstrap.cc:492] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:49.565264 16231 ts_tablet_manager.cc:1403] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.013s
I20260201 08:58:49.567790 16231 raft_consensus.cc:359] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.569068 16231 raft_consensus.cc:740] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:49.569623 16231 consensus_queue.cc:260] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.571269 16231 ts_tablet_manager.cc:1434] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260201 08:58:49.572762 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-5ea6d15904e84f4db55e93adfea29377 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:49.573181 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-5ea6d15904e84f4db55e93adfea29377 on tablet 5ea6d15904e84f4db55e93adfea29377 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:49.595695 16231 ts_tablet_manager.cc:933] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:49.598371 16231 tablet_copy_client.cc:323] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:49.599849 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet 2706b5ec373d40a9bbf0d09ab72966d9 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:49.600348 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet 2706b5ec373d40a9bbf0d09ab72966d9 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-2706b5ec373d40a9bbf0d09ab72966d9
I20260201 08:58:49.607318 15479 tablet_copy_source_session.cc:215] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:49.609897 16231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2706b5ec373d40a9bbf0d09ab72966d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:49.623056 16231 tablet_copy_client.cc:806] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:49.623663 16231 tablet_copy_client.cc:670] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:49.627467 16231 tablet_copy_client.cc:538] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:49.634900 16231 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:49.643384 16229 ts_tablet_manager.cc:933] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:49.646289 16229 tablet_copy_client.cc:323] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:49.648393 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet c37d9e5e810f4cde8bf85667cc298883 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:49.648955 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet c37d9e5e810f4cde8bf85667cc298883 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-c37d9e5e810f4cde8bf85667cc298883
I20260201 08:58:49.661617 16231 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:49.662415 16231 tablet_bootstrap.cc:492] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:49.662942 16231 ts_tablet_manager.cc:1403] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.002s
I20260201 08:58:49.663015 15404 tablet_copy_source_session.cc:215] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:49.665593 16231 raft_consensus.cc:359] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.666200 16229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c37d9e5e810f4cde8bf85667cc298883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:49.666440 16231 raft_consensus.cc:740] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:49.668619 16231 consensus_queue.cc:260] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.673105 16231 ts_tablet_manager.cc:1434] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260201 08:58:49.676023 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-2706b5ec373d40a9bbf0d09ab72966d9 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:49.676451 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-2706b5ec373d40a9bbf0d09ab72966d9 on tablet 2706b5ec373d40a9bbf0d09ab72966d9 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:49.685456 16229 tablet_copy_client.cc:806] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:49.686056 16229 tablet_copy_client.cc:670] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:49.689985 16229 tablet_copy_client.cc:538] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:49.700462 16229 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:49.717267 16229 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:49.717993 16229 tablet_bootstrap.cc:492] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:49.718556 16229 ts_tablet_manager.cc:1403] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.018s user 0.019s sys 0.000s
I20260201 08:58:49.721114 16229 raft_consensus.cc:359] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.721876 16229 raft_consensus.cc:740] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:49.722512 16229 consensus_queue.cc:260] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:49.725117 16229 ts_tablet_manager.cc:1434] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:58:49.726902 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-c37d9e5e810f4cde8bf85667cc298883 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:49.727468 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-c37d9e5e810f4cde8bf85667cc298883 on tablet c37d9e5e810f4cde8bf85667cc298883 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:49.909499 15975 raft_consensus.cc:1217] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:50.069662 15975 raft_consensus.cc:1217] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:50.091670 15975 raft_consensus.cc:1217] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:50.259351 15975 raft_consensus.cc:1217] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:50.422266 16241 raft_consensus.cc:1064] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:50.424552 16241 consensus_queue.cc:237] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.430642 15974 raft_consensus.cc:1275] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.431356 15466 raft_consensus.cc:1275] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.431804 15392 raft_consensus.cc:1275] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.433020 16240 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:50.433917 16241 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:50.434743 16214 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:50.445291 16240 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.446931 15974 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.448137 15392 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.457244 15466 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.466395 15216 catalog_manager.cc:5654] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.492426 15317 consensus_queue.cc:237] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.500073 15395 raft_consensus.cc:1275] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.501173 16241 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:50.503384 15974 raft_consensus.cc:1275] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.508939 16241 consensus_queue.cc:1048] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:50.510380 16214 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.514770 15392 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.517041 15974 raft_consensus.cc:2955] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.532130 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 72a1146f3e714f4c9b68d5f668ce839c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:50.535990 15218 catalog_manager.cc:5654] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.561120 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 72a1146f3e714f4c9b68d5f668ce839c with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:50.563189 16251 tablet_replica.cc:333] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:50.569851 16251 raft_consensus.cc:2243] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:50.570529 16251 raft_consensus.cc:2272] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:50.573643 16251 ts_tablet_manager.cc:1916] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:50.583663 16241 raft_consensus.cc:1064] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:50.585750 16241 consensus_queue.cc:237] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.587426 16251 ts_tablet_manager.cc:1929] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:50.587802 16251 log.cc:1199] T 72a1146f3e714f4c9b68d5f668ce839c P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/72a1146f3e714f4c9b68d5f668ce839c
I20260201 08:58:50.589231 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 72a1146f3e714f4c9b68d5f668ce839c (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:50.596210 15974 raft_consensus.cc:1275] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.598008 16214 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:50.602711 15466 raft_consensus.cc:1275] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.604725 16213 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:50.616057 15394 raft_consensus.cc:1275] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.617117 16213 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:50.621987 16254 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.631490 15974 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.644328 15466 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.650507 15213 catalog_manager.cc:5654] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:50.652997 15394 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.674130 15320 consensus_queue.cc:237] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.680289 15469 raft_consensus.cc:1275] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.680328 15975 raft_consensus.cc:1275] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.681869 16213 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:50.682762 16241 consensus_queue.cc:1048] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:50.684075 16202 raft_consensus.cc:1064] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:50.686262 16202 consensus_queue.cc:237] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.688983 16241 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.690590 15974 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.695791 15467 raft_consensus.cc:2955] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.699059 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 5ea6d15904e84f4db55e93adfea29377 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:50.707746 15213 catalog_manager.cc:5654] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.727035 15320 raft_consensus.cc:1275] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.728719 16173 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:50.730124 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 5ea6d15904e84f4db55e93adfea29377 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:50.733405 15974 raft_consensus.cc:1275] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.734833 15394 raft_consensus.cc:1275] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.744019 16259 tablet_replica.cc:333] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:50.748086 16173 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:50.749457 16259 raft_consensus.cc:2243] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:50.750200 16259 raft_consensus.cc:2272] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:50.750162 16223 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:50.753659 16259 ts_tablet_manager.cc:1916] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:50.776015 16223 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.778184 15394 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.778204 15974 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.782855 16259 ts_tablet_manager.cc:1929] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:50.783376 16259 log.cc:1199] T 5ea6d15904e84f4db55e93adfea29377 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/5ea6d15904e84f4db55e93adfea29377
I20260201 08:58:50.792695 15320 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.793783 15217 catalog_manager.cc:5654] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.808043 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 5ea6d15904e84f4db55e93adfea29377 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:50.850733 15469 consensus_queue.cc:237] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.856029 15317 raft_consensus.cc:1275] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.856252 15974 raft_consensus.cc:1275] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.857371 16173 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:50.859969 16263 consensus_queue.cc:1048] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:50.866918 16258 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.872184 15317 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.873096 15975 raft_consensus.cc:2955] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.875876 16208 raft_consensus.cc:1064] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:50.878329 16208 consensus_queue.cc:237] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.882194 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 2706b5ec373d40a9bbf0d09ab72966d9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:50.887768 15217 catalog_manager.cc:5654] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.888847 15975 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.891894 15469 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.894152 16242 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:50.897240 15317 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:50.900390 16208 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:50.910862 16265 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:50.912930 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 2706b5ec373d40a9bbf0d09ab72966d9 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:50.914253 16259 tablet_replica.cc:333] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:50.923900 16259 raft_consensus.cc:2243] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:50.924592 16259 raft_consensus.cc:2272] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:50.926422 16242 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.927775 16259 ts_tablet_manager.cc:1916] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:50.930250 15975 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.930495 15320 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.944425 15217 catalog_manager.cc:5654] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.947558 15469 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.949506 16259 ts_tablet_manager.cc:1929] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:50.950014 16259 log.cc:1199] T 2706b5ec373d40a9bbf0d09ab72966d9 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/2706b5ec373d40a9bbf0d09ab72966d9
I20260201 08:58:50.951788 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 2706b5ec373d40a9bbf0d09ab72966d9 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:50.965310 15392 consensus_queue.cc:237] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:50.970214 15975 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.971335 15469 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:50.972765 16265 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:58:50.984047 16242 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:50.986545 16208 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.992758 15975 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:50.994179 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c37d9e5e810f4cde8bf85667cc298883 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:51.001941 15469 raft_consensus.cc:2955] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:51.004640 15218 catalog_manager.cc:5654] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:51.016978 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet c37d9e5e810f4cde8bf85667cc298883 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:51.018858 16269 tablet_replica.cc:333] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:51.019975 16269 raft_consensus.cc:2243] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:51.024143 16269 raft_consensus.cc:2272] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:51.028806 16269 ts_tablet_manager.cc:1916] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:51.039247 16269 ts_tablet_manager.cc:1929] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:51.039616 16269 log.cc:1199] T c37d9e5e810f4cde8bf85667cc298883 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/c37d9e5e810f4cde8bf85667cc298883
I20260201 08:58:51.041042 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet c37d9e5e810f4cde8bf85667cc298883 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:52.061882 15317 consensus_queue.cc:237] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.067119 15467 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:52.067687 15284 consensus_peers.cc:597] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e64d88347b44f8e8c8f0aa30d129641. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:52.067996 15392 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:52.068533 16254 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.069383 16273 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.077281 16254 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.078930 15467 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.084263 15392 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.096784 15217 catalog_manager.cc:5654] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:52.097373 15467 consensus_queue.cc:237] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:58:52.117662 15433 consensus_peers.cc:597] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 491c0efe7c624b5f98f4894361bf6e68. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:52.118175 15392 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:52.118413 15317 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:52.119791 16270 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.120694 16173 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.132826 16173 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.134518 15392 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.148309 15317 consensus_queue.cc:237] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.156389 15320 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:58:52.162885 15284 consensus_peers.cc:597] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 611e2cdf949d4159bce7bcd1606d9604. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:52.162808 15392 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:52.161856 15467 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:52.164963 16276 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.165814 16254 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.154449 15218 catalog_manager.cc:5654] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:52.179636 16276 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.184824 15392 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.189152 15467 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.193240 15469 consensus_queue.cc:237] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:58:52.205595 15433 consensus_peers.cc:597] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d06ae7b6994d4f5a99bb33b73a0719d0. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:52.210011 15392 raft_consensus.cc:1275] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:52.211582 16258 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.212431 15320 raft_consensus.cc:1275] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:52.213660 16173 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:52.216482 15217 catalog_manager.cc:5654] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.234005 16270 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.252799 15213 catalog_manager.cc:5654] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:52.257368 15320 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.259038 15392 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:52.512578 16292 ts_tablet_manager.cc:933] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:52.514688 16292 tablet_copy_client.cc:323] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:52.515974 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet 491c0efe7c624b5f98f4894361bf6e68 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:52.516490 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet 491c0efe7c624b5f98f4894361bf6e68 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-491c0efe7c624b5f98f4894361bf6e68
I20260201 08:58:52.521904 15479 tablet_copy_source_session.cc:215] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:52.524590 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 491c0efe7c624b5f98f4894361bf6e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:52.538071 16292 tablet_copy_client.cc:806] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:52.538741 16292 tablet_copy_client.cc:670] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:52.541886 16292 tablet_copy_client.cc:538] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:52.549824 16292 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:52.566773 16292 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:52.567637 16292 tablet_bootstrap.cc:492] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:52.568284 16292 ts_tablet_manager.cc:1403] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20260201 08:58:52.570906 16292 raft_consensus.cc:359] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.571703 16292 raft_consensus.cc:740] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:52.572305 16292 consensus_queue.cc:260] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.577663 16292 ts_tablet_manager.cc:1434] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.009s user 0.007s sys 0.004s
I20260201 08:58:52.578933 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-491c0efe7c624b5f98f4894361bf6e68 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:52.579339 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-491c0efe7c624b5f98f4894361bf6e68 on tablet 491c0efe7c624b5f98f4894361bf6e68 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:52.603982 16292 ts_tablet_manager.cc:933] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:52.606534 16292 tablet_copy_client.cc:323] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:52.607841 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 0e64d88347b44f8e8c8f0aa30d129641 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:52.608355 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 0e64d88347b44f8e8c8f0aa30d129641 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-0e64d88347b44f8e8c8f0aa30d129641
I20260201 08:58:52.614791 15330 tablet_copy_source_session.cc:215] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:52.617311 16292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e64d88347b44f8e8c8f0aa30d129641. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:52.623091 16297 ts_tablet_manager.cc:933] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:52.624827 16297 tablet_copy_client.cc:323] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:52.626312 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 611e2cdf949d4159bce7bcd1606d9604 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:52.626829 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 611e2cdf949d4159bce7bcd1606d9604 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-611e2cdf949d4159bce7bcd1606d9604
I20260201 08:58:52.632089 16292 tablet_copy_client.cc:806] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:52.632723 16292 tablet_copy_client.cc:670] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:52.634951 15330 tablet_copy_source_session.cc:215] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:52.636202 16292 tablet_copy_client.cc:538] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:52.637840 16297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611e2cdf949d4159bce7bcd1606d9604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:52.644687 16292 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:52.660282 16297 tablet_copy_client.cc:806] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:52.661911 16297 tablet_copy_client.cc:670] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:52.668061 16297 tablet_copy_client.cc:538] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:52.669013 16292 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:52.669840 16292 tablet_bootstrap.cc:492] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:52.670449 16292 ts_tablet_manager.cc:1403] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.026s user 0.025s sys 0.000s
I20260201 08:58:52.672681 16292 raft_consensus.cc:359] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.673269 16292 raft_consensus.cc:740] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:52.673857 16292 consensus_queue.cc:260] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.675252 16297 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:52.676471 16292 ts_tablet_manager.cc:1434] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:58:52.679579 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-0e64d88347b44f8e8c8f0aa30d129641 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:52.680204 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-0e64d88347b44f8e8c8f0aa30d129641 on tablet 0e64d88347b44f8e8c8f0aa30d129641 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:52.695269 16297 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:52.696278 16297 tablet_bootstrap.cc:492] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:52.696985 16297 ts_tablet_manager.cc:1403] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.006s
I20260201 08:58:52.699381 16297 raft_consensus.cc:359] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.700080 16297 raft_consensus.cc:740] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:52.700686 16297 consensus_queue.cc:260] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.702620 16297 ts_tablet_manager.cc:1434] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:58:52.705672 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-611e2cdf949d4159bce7bcd1606d9604 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:52.706121 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-611e2cdf949d4159bce7bcd1606d9604 on tablet 611e2cdf949d4159bce7bcd1606d9604 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:52.756392 16297 ts_tablet_manager.cc:933] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:52.759327 16297 tablet_copy_client.cc:323] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:52.760773 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet d06ae7b6994d4f5a99bb33b73a0719d0 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:52.761276 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet d06ae7b6994d4f5a99bb33b73a0719d0 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-d06ae7b6994d4f5a99bb33b73a0719d0
I20260201 08:58:52.767628 15479 tablet_copy_source_session.cc:215] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:52.771154 16297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06ae7b6994d4f5a99bb33b73a0719d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:52.784746 16297 tablet_copy_client.cc:806] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:52.785370 16297 tablet_copy_client.cc:670] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:52.789749 16297 tablet_copy_client.cc:538] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:52.797813 16297 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:52.816128 16297 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:52.817972 16297 tablet_bootstrap.cc:492] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:52.818653 16297 ts_tablet_manager.cc:1403] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.021s user 0.017s sys 0.000s
I20260201 08:58:52.821302 16297 raft_consensus.cc:359] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.822151 16297 raft_consensus.cc:740] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:52.822826 16297 consensus_queue.cc:260] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:52.826812 16297 ts_tablet_manager.cc:1434] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:58:52.829639 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-d06ae7b6994d4f5a99bb33b73a0719d0 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:52.830063 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-d06ae7b6994d4f5a99bb33b73a0719d0 on tablet d06ae7b6994d4f5a99bb33b73a0719d0 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:53.004973 15974 raft_consensus.cc:1217] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:53.014509 15974 raft_consensus.cc:1217] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:53.122599 15974 raft_consensus.cc:1217] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:53.321975 15974 raft_consensus.cc:1217] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:53.448108 16270 raft_consensus.cc:1064] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:53.450423 16270 consensus_queue.cc:237] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.456195 15395 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.456481 15316 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.457408 15975 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.457912 16270 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.458673 16305 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.459697 16290 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.471217 16270 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.474009 15392 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.476737 15974 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.490973 15317 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.498570 15213 catalog_manager.cc:5654] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.542927 16254 raft_consensus.cc:1064] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:53.545039 16254 consensus_queue.cc:237] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.546680 15466 consensus_queue.cc:237] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.552363 15395 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.555827 16270 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:53.560587 15975 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.561889 16303 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.562237 15974 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.566063 15466 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.568670 16306 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.573585 16254 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.569984 15392 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.575997 16270 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:53.574446 15395 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.578189 16254 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.594254 16303 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.597208 15216 catalog_manager.cc:5654] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:53.601897 15974 raft_consensus.cc:2955] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.601130 15395 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.603974 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 491c0efe7c624b5f98f4894361bf6e68 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:53.605343 15467 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.623670 16321 raft_consensus.cc:1064] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:53.626410 16321 consensus_queue.cc:237] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.628641 15213 catalog_manager.cc:5654] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.629287 15975 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.634768 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet 491c0efe7c624b5f98f4894361bf6e68 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:53.634861 15395 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.635426 15466 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.635716 15974 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.645550 16276 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.647512 16276 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.651396 16322 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.676221 16325 tablet_replica.cc:333] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:53.677147 16325 raft_consensus.cc:2243] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:53.679677 16323 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.682591 15395 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.683763 16325 raft_consensus.cc:2272] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:53.691152 15317 consensus_queue.cc:237] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.694314 15466 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.701977 15394 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.703230 15975 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.707594 16325 ts_tablet_manager.cc:1916] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:53.712016 15213 catalog_manager.cc:5654] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.701304 15974 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.721334 16276 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:53.723471 16276 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:53.727151 16325 ts_tablet_manager.cc:1929] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:53.727705 16325 log.cc:1199] T 491c0efe7c624b5f98f4894361bf6e68 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/491c0efe7c624b5f98f4894361bf6e68
I20260201 08:58:53.729439 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet 491c0efe7c624b5f98f4894361bf6e68 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:53.735096 16323 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.740191 15395 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.744879 15973 raft_consensus.cc:2955] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.747406 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 0e64d88347b44f8e8c8f0aa30d129641 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:53.756935 15316 consensus_queue.cc:237] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.763837 15975 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.765477 16254 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:53.766036 15218 catalog_manager.cc:5654] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.771456 15467 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.773593 16254 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:53.779320 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e64d88347b44f8e8c8f0aa30d129641 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:53.788798 16276 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.793011 15466 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.802407 16330 tablet_replica.cc:333] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:53.811872 15975 raft_consensus.cc:2955] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.818781 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 611e2cdf949d4159bce7bcd1606d9604 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:53.822535 15213 catalog_manager.cc:5654] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.828788 16330 raft_consensus.cc:2243] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:53.832027 16330 raft_consensus.cc:2272] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:53.835300 16330 ts_tablet_manager.cc:1916] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:53.843173 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 611e2cdf949d4159bce7bcd1606d9604 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:53.887862 16331 tablet_replica.cc:333] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:53.888916 16331 raft_consensus.cc:2243] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:53.889719 16331 raft_consensus.cc:2272] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:53.894578 16331 ts_tablet_manager.cc:1916] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:53.897389 16330 ts_tablet_manager.cc:1929] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:53.897903 16330 log.cc:1199] T 0e64d88347b44f8e8c8f0aa30d129641 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/0e64d88347b44f8e8c8f0aa30d129641
I20260201 08:58:53.900758 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 0e64d88347b44f8e8c8f0aa30d129641 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:53.901952 16290 raft_consensus.cc:1064] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:53.904428 16290 consensus_queue.cc:237] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.912240 15975 raft_consensus.cc:1275] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.914868 15394 raft_consensus.cc:1275] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.915066 15316 raft_consensus.cc:1275] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:53.914829 16331 ts_tablet_manager.cc:1929] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:53.915979 16331 log.cc:1199] T 611e2cdf949d4159bce7bcd1606d9604 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/611e2cdf949d4159bce7bcd1606d9604
I20260201 08:58:53.917470 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 611e2cdf949d4159bce7bcd1606d9604 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:53.917493 16308 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:53.919236 16290 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.919958 16306 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:53.945804 16305 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.951524 15975 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.956610 15320 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.966614 15213 catalog_manager.cc:5654] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.967227 15394 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:53.988585 15467 consensus_queue.cc:237] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:53.992903 15975 raft_consensus.cc:1275] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.993359 15394 raft_consensus.cc:1275] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:53.994360 16305 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:53.995244 16290 consensus_queue.cc:1048] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:54.001328 16305 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:54.011335 15975 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:54.015708 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d06ae7b6994d4f5a99bb33b73a0719d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:54.017114 15394 raft_consensus.cc:2955] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:54.018643 15217 catalog_manager.cc:5654] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:54.034361 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet d06ae7b6994d4f5a99bb33b73a0719d0 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:54.035281 16325 tablet_replica.cc:333] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:54.035969 16325 raft_consensus.cc:2243] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:54.036512 16325 raft_consensus.cc:2272] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:54.038939 16325 ts_tablet_manager.cc:1916] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:54.050416 16325 ts_tablet_manager.cc:1929] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:54.050806 16325 log.cc:1199] T d06ae7b6994d4f5a99bb33b73a0719d0 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/d06ae7b6994d4f5a99bb33b73a0719d0
I20260201 08:58:54.052157 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet d06ae7b6994d4f5a99bb33b73a0719d0 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:55.081995 15320 consensus_queue.cc:237] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.087728 15467 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:55.089128 15284 consensus_peers.cc:597] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a6f3a1022c04fbea745045247de85a4. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:55.089859 16323 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:55.090909 15394 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:55.092216 16323 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:55.097575 16276 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.100844 15394 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.099651 15467 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.117836 15394 consensus_queue.cc:237] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.119201 15216 catalog_manager.cc:5654] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:55.139889 15359 consensus_peers.cc:597] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11b460db7c0c4e2a8c257d149e4d4111. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:55.140923 15320 raft_consensus.cc:1275] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:55.153985 16304 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:55.155205 15469 raft_consensus.cc:1275] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:55.174998 16329 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:55.189311 16347 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.200366 15320 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.208465 15469 consensus_queue.cc:237] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.211076 15466 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.217255 15218 catalog_manager.cc:5654] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:55.231657 15394 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:55.231891 15320 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:55.231607 15433 consensus_peers.cc:597] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d83cd76a3c124667a5c4e76abfdcb0e6. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:55.233399 16345 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:55.234242 16343 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:55.243440 16343 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.244832 15394 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.247915 15316 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.259560 15320 consensus_queue.cc:237] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.261819 15217 catalog_manager.cc:5654] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:55.269110 15395 raft_consensus.cc:1275] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:55.270205 15284 consensus_peers.cc:597] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ddc7ec3a25a454b880657949ea0b9da. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:55.270351 15469 raft_consensus.cc:1275] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:55.271023 16276 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:55.275336 16276 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:55.297509 16339 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.299957 15395 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.299957 15469 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.318023 15217 catalog_manager.cc:5654] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:55.528306 16359 ts_tablet_manager.cc:933] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:55.530112 16359 tablet_copy_client.cc:323] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:55.531456 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 1a6f3a1022c04fbea745045247de85a4 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:55.532016 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 1a6f3a1022c04fbea745045247de85a4 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-1a6f3a1022c04fbea745045247de85a4
I20260201 08:58:55.537992 15330 tablet_copy_source_session.cc:215] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:55.540776 16359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a6f3a1022c04fbea745045247de85a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:55.553331 16359 tablet_copy_client.cc:806] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:55.553871 16359 tablet_copy_client.cc:670] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:55.557231 16359 tablet_copy_client.cc:538] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:55.564091 16359 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:55.584203 16359 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:55.585100 16359 tablet_bootstrap.cc:492] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:55.585624 16359 ts_tablet_manager.cc:1403] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.004s
I20260201 08:58:55.587839 16359 raft_consensus.cc:359] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.588613 16359 raft_consensus.cc:740] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:55.589243 16359 consensus_queue.cc:260] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.596915 16359 ts_tablet_manager.cc:1434] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260201 08:58:55.599385 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-1a6f3a1022c04fbea745045247de85a4 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:55.599840 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-1a6f3a1022c04fbea745045247de85a4 on tablet 1a6f3a1022c04fbea745045247de85a4 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:55.639614 16359 ts_tablet_manager.cc:933] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:55.641202 16359 tablet_copy_client.cc:323] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:55.642591 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet d83cd76a3c124667a5c4e76abfdcb0e6 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:55.643105 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet d83cd76a3c124667a5c4e76abfdcb0e6 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-d83cd76a3c124667a5c4e76abfdcb0e6
I20260201 08:58:55.650235 16364 ts_tablet_manager.cc:933] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:55.651916 16364 tablet_copy_client.cc:323] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:55.652628 15479 tablet_copy_source_session.cc:215] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:55.653077 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 6ddc7ec3a25a454b880657949ea0b9da from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:55.653497 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 6ddc7ec3a25a454b880657949ea0b9da from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-6ddc7ec3a25a454b880657949ea0b9da
I20260201 08:58:55.655560 16359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d83cd76a3c124667a5c4e76abfdcb0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:55.660601 15330 tablet_copy_source_session.cc:215] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:55.663316 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ddc7ec3a25a454b880657949ea0b9da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:55.677799 16364 tablet_copy_client.cc:806] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:55.678436 16364 tablet_copy_client.cc:670] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:55.681869 16364 tablet_copy_client.cc:538] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:55.687501 16359 tablet_copy_client.cc:806] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:55.688433 16359 tablet_copy_client.cc:670] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:55.696416 16359 tablet_copy_client.cc:538] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:55.711743 16364 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:55.716619 16359 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:55.726459 16366 ts_tablet_manager.cc:933] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:55.737788 16366 tablet_copy_client.cc:323] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:55.741308 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 11b460db7c0c4e2a8c257d149e4d4111 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:55.741828 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 11b460db7c0c4e2a8c257d149e4d4111 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-11b460db7c0c4e2a8c257d149e4d4111
I20260201 08:58:55.748603 16364 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:55.748800 16359 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:55.749577 16364 tablet_bootstrap.cc:492] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:55.749593 16359 tablet_bootstrap.cc:492] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:55.750389 16359 ts_tablet_manager.cc:1403] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.034s user 0.024s sys 0.008s
I20260201 08:58:55.750404 16364 ts_tablet_manager.cc:1403] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.039s user 0.014s sys 0.008s
I20260201 08:58:55.753507 16359 raft_consensus.cc:359] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.754101 16359 raft_consensus.cc:740] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:55.753865 16364 raft_consensus.cc:359] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.754659 16364 raft_consensus.cc:740] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:55.754745 16359 consensus_queue.cc:260] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.755311 16364 consensus_queue.cc:260] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.758092 16359 ts_tablet_manager.cc:1434] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260201 08:58:55.763237 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-d83cd76a3c124667a5c4e76abfdcb0e6 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:55.763643 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-d83cd76a3c124667a5c4e76abfdcb0e6 on tablet d83cd76a3c124667a5c4e76abfdcb0e6 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:55.767668 15404 tablet_copy_source_session.cc:215] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:55.775588 16364 ts_tablet_manager.cc:1434] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.025s user 0.000s sys 0.015s
I20260201 08:58:55.776262 16366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b460db7c0c4e2a8c257d149e4d4111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:55.777150 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-6ddc7ec3a25a454b880657949ea0b9da received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:55.777586 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-6ddc7ec3a25a454b880657949ea0b9da on tablet 6ddc7ec3a25a454b880657949ea0b9da with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:55.792018 16366 tablet_copy_client.cc:806] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:55.792604 16366 tablet_copy_client.cc:670] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:55.795935 16366 tablet_copy_client.cc:538] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:55.805509 16366 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:55.821805 16366 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:55.822746 16366 tablet_bootstrap.cc:492] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:55.823411 16366 ts_tablet_manager.cc:1403] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.004s
I20260201 08:58:55.826881 16366 raft_consensus.cc:359] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.827845 16366 raft_consensus.cc:740] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:55.828514 16366 consensus_queue.cc:260] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:55.832842 16366 ts_tablet_manager.cc:1434] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260201 08:58:55.834185 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-11b460db7c0c4e2a8c257d149e4d4111 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:55.834492 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-11b460db7c0c4e2a8c257d149e4d4111 on tablet 11b460db7c0c4e2a8c257d149e4d4111 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:56.106206 15975 raft_consensus.cc:1217] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:56.120462 15975 raft_consensus.cc:1217] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:56.156582 15973 raft_consensus.cc:1217] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:56.169752 15975 raft_consensus.cc:1217] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:56.632344 16372 raft_consensus.cc:1064] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:56.634555 16343 raft_consensus.cc:1064] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:56.634867 16372 consensus_queue.cc:237] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:56.636837 16343 consensus_queue.cc:237] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:56.640421 15973 raft_consensus.cc:1275] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.642583 16339 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.647220 15469 raft_consensus.cc:1275] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.651247 15395 raft_consensus.cc:1275] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.654153 16352 raft_consensus.cc:1064] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:56.655169 15395 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.656476 16345 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.658463 15973 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.656610 16352 consensus_queue.cc:237] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:56.656898 16339 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.660847 16343 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.663952 16339 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.668345 16377 raft_consensus.cc:1064] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:56.673094 16377 consensus_queue.cc:237] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:56.677656 15320 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.680948 16373 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.693133 15975 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.699841 15974 raft_consensus.cc:1275] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.701363 16351 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.702819 16343 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.704222 15469 raft_consensus.cc:1275] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.704159 15312 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.707549 16351 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.711159 15974 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.724642 15316 raft_consensus.cc:1275] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260201 08:58:56.782586 16383 log.cc:927] Time spent T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260201 08:58:56.727494 16351 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260201 08:58:56.708853 16339 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
W20260201 08:58:56.805917 15361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:41253, user_credentials={real_user=slave}} blocked reactor thread for 46950.5us
I20260201 08:58:56.809589 15216 catalog_manager.cc:5654] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.824054 15466 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.808230 15213 catalog_manager.cc:5654] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:56.847172 15392 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.875559 15466 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.876983 16391 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.880820 16351 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.883380 15316 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.894342 15974 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.895313 15469 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.906549 15395 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:56.894989 15973 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.910010 16377 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:56.924566 15395 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.936758 16391 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:56.942914 16387 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.949194 15977 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.962853 15469 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.978863 15465 consensus_queue.cc:237] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:56.977006 15395 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.990696 15973 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:56.992489 16343 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:56.992986 15218 catalog_manager.cc:5654] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:56.994594 15218 catalog_manager.cc:5654] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.004443 15313 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:57.006996 16343 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:57.005604 16395 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.009974 15977 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.016706 15316 raft_consensus.cc:2955] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.018368 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet d83cd76a3c124667a5c4e76abfdcb0e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260201 08:58:57.034590 15205 catalog_manager.cc:5177] ChangeConfig:REMOVE_PEER RPC for tablet d83cd76a3c124667a5c4e76abfdcb0e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260201 08:58:57.039858 15395 consensus_queue.cc:237] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:57.038309 15320 consensus_queue.cc:237] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:57.042229 15218 catalog_manager.cc:5654] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.038776 15313 consensus_queue.cc:237] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:57.054003 15393 raft_consensus.cc:1275] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:57.054477 15465 raft_consensus.cc:1275] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:57.055295 15973 raft_consensus.cc:1275] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:57.055851 16351 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:57.056078 16387 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:57.059388 16351 consensus_queue.cc:1048] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:57.069839 16329 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.073901 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet d83cd76a3c124667a5c4e76abfdcb0e6 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:57.075390 15973 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:57.075951 15395 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:57.076730 15974 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.086299 16396 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:57.085649 16339 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.085947 15465 raft_consensus.cc:2955] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.089885 15395 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.093449 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 11b460db7c0c4e2a8c257d149e4d4111 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:57.095301 16396 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:57.103443 16391 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.085670 15977 raft_consensus.cc:1275] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:57.107249 15392 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.108455 16396 consensus_queue.cc:1048] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:57.114446 15218 catalog_manager.cc:5654] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.116110 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 1a6f3a1022c04fbea745045247de85a4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:57.115456 15974 raft_consensus.cc:2955] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.124534 15973 raft_consensus.cc:2955] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.138260 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet 11b460db7c0c4e2a8c257d149e4d4111 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:58:57.146831 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6ddc7ec3a25a454b880657949ea0b9da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:57.188102 16409 tablet_replica.cc:333] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:58:57.185359 15217 catalog_manager.cc:5654] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:57.189342 16408 tablet_replica.cc:333] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:57.194940 16408 raft_consensus.cc:2243] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:57.189497 16409 raft_consensus.cc:2243] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:57.195691 16408 raft_consensus.cc:2272] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:57.196362 16409 raft_consensus.cc:2272] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:57.199708 16409 ts_tablet_manager.cc:1916] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:57.200541 16408 ts_tablet_manager.cc:1916] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:57.204766 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 1a6f3a1022c04fbea745045247de85a4 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:57.206429 16410 tablet_replica.cc:333] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:57.204316 15218 catalog_manager.cc:5654] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:57.223064 16408 ts_tablet_manager.cc:1929] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:57.223608 16408 log.cc:1199] T d83cd76a3c124667a5c4e76abfdcb0e6 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/d83cd76a3c124667a5c4e76abfdcb0e6
I20260201 08:58:57.225318 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet d83cd76a3c124667a5c4e76abfdcb0e6 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:57.225998 16410 raft_consensus.cc:2243] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:57.226737 16410 raft_consensus.cc:2272] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:57.227754 16409 ts_tablet_manager.cc:1929] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:57.228574 16409 log.cc:1199] T 11b460db7c0c4e2a8c257d149e4d4111 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/11b460db7c0c4e2a8c257d149e4d4111
I20260201 08:58:57.228999 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 6ddc7ec3a25a454b880657949ea0b9da with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:58:57.230185 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet 11b460db7c0c4e2a8c257d149e4d4111 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:57.231648 16410 ts_tablet_manager.cc:1916] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:57.244293 16410 ts_tablet_manager.cc:1929] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:57.244767 16410 log.cc:1199] T 1a6f3a1022c04fbea745045247de85a4 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/1a6f3a1022c04fbea745045247de85a4
I20260201 08:58:57.246308 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 1a6f3a1022c04fbea745045247de85a4 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:57.246492 16410 tablet_replica.cc:333] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:58:57.247587 16410 raft_consensus.cc:2243] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:57.248306 16410 raft_consensus.cc:2272] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:57.250931 16410 ts_tablet_manager.cc:1916] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:57.262472 16410 ts_tablet_manager.cc:1929] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:58:57.263299 16410 log.cc:1199] T 6ddc7ec3a25a454b880657949ea0b9da P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/6ddc7ec3a25a454b880657949ea0b9da
I20260201 08:58:57.264365 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 6ddc7ec3a25a454b880657949ea0b9da (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:58:58.261422 15469 consensus_queue.cc:237] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:58.266561 15392 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:58.267041 15433 consensus_peers.cc:597] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2914abdfc16e44c98c0e73c8c82e4c45. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:58.267735 15316 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:58.267930 16395 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:58:58.269065 16343 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:58.276818 16343 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.279909 15392 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.284406 15316 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.301549 15395 consensus_queue.cc:237] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:58.300645 15217 catalog_manager.cc:5654] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260201 08:58:58.308887 15359 consensus_peers.cc:597] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bd7a5722773409789e77823ae3e57e9. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:58.310309 15469 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:58.310564 15316 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:58.311759 16393 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:58.312806 16351 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:58.322281 16419 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.325465 15469 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.326622 15320 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.341725 15320 consensus_queue.cc:237] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:58.343189 15218 catalog_manager.cc:5654] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.349146 15469 raft_consensus.cc:1275] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:58:58.349409 15284 consensus_peers.cc:597] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cce9e137d99477387581030f09ca781. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:58.351096 16396 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:58.352972 15395 raft_consensus.cc:1275] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:58.354643 16387 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:58.378499 16387 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.383127 15465 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.410117 15217 catalog_manager.cc:5654] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.418545 15393 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.439024 15395 consensus_queue.cc:237] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:58:58.452087 15359 consensus_peers.cc:597] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3165dd57af4a455d83facbd02fcb4b80. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:58:58.453795 15320 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:58.454083 15465 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:58:58.455178 16393 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:58.456025 16351 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:58:58.463235 16393 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.464910 15320 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.466246 15465 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:58:58.488344 15213 catalog_manager.cc:5654] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:58.807119 16434 ts_tablet_manager.cc:933] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:58.814211 16434 tablet_copy_client.cc:323] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:58.817062 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 6bd7a5722773409789e77823ae3e57e9 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:58.818014 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 6bd7a5722773409789e77823ae3e57e9 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-6bd7a5722773409789e77823ae3e57e9
I20260201 08:58:58.830137 15404 tablet_copy_source_session.cc:215] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:58.836326 16434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd7a5722773409789e77823ae3e57e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:58.866802 16434 tablet_copy_client.cc:806] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:58.867376 16434 tablet_copy_client.cc:670] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:58.870606 16434 tablet_copy_client.cc:538] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:58.880896 16434 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:58.891831 16436 ts_tablet_manager.cc:933] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:58.896803 16436 tablet_copy_client.cc:323] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:58:58.898746 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet 2914abdfc16e44c98c0e73c8c82e4c45 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:58:58.899382 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet 2914abdfc16e44c98c0e73c8c82e4c45 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-2914abdfc16e44c98c0e73c8c82e4c45
I20260201 08:58:58.901609 16434 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:58.902514 16434 tablet_bootstrap.cc:492] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:58.903139 16434 ts_tablet_manager.cc:1403] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.023s user 0.023s sys 0.001s
I20260201 08:58:58.906822 16434 raft_consensus.cc:359] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:58.907872 16434 raft_consensus.cc:740] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:58.908699 16434 consensus_queue.cc:260] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:58.912355 15479 tablet_copy_source_session.cc:215] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:58.916451 16436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2914abdfc16e44c98c0e73c8c82e4c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:58.920179 16434 ts_tablet_manager.cc:1434] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.017s user 0.012s sys 0.001s
I20260201 08:58:58.923722 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-6bd7a5722773409789e77823ae3e57e9 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:58.924317 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-6bd7a5722773409789e77823ae3e57e9 on tablet 6bd7a5722773409789e77823ae3e57e9 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:58.938719 16436 tablet_copy_client.cc:806] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:58.939474 16436 tablet_copy_client.cc:670] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:58.956106 16434 ts_tablet_manager.cc:933] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:58:58.964952 16436 tablet_copy_client.cc:538] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:58.977542 16434 tablet_copy_client.cc:323] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:58:58.979779 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 8cce9e137d99477387581030f09ca781 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:58:58.980366 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 8cce9e137d99477387581030f09ca781 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-8cce9e137d99477387581030f09ca781
I20260201 08:58:58.983770 16436 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:58.999854 15330 tablet_copy_source_session.cc:215] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:59.008072 16434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cce9e137d99477387581030f09ca781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:59.016815 16436 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:59.017764 16436 tablet_bootstrap.cc:492] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:59.018456 16436 ts_tablet_manager.cc:1403] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.035s user 0.020s sys 0.008s
I20260201 08:58:59.021834 16436 raft_consensus.cc:359] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.022673 16436 raft_consensus.cc:740] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:59.023339 16436 consensus_queue.cc:260] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.028383 16436 ts_tablet_manager.cc:1434] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260201 08:58:59.031378 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-2914abdfc16e44c98c0e73c8c82e4c45 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:58:59.031870 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-2914abdfc16e44c98c0e73c8c82e4c45 on tablet 2914abdfc16e44c98c0e73c8c82e4c45 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:59.033299 16434 tablet_copy_client.cc:806] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:59.035735 16434 tablet_copy_client.cc:670] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:59.036672 16436 ts_tablet_manager.cc:933] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:59.041385 16434 tablet_copy_client.cc:538] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:59.052029 16434 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:59.053077 16436 tablet_copy_client.cc:323] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:58:59.054589 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 3165dd57af4a455d83facbd02fcb4b80 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:58:59.055163 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 3165dd57af4a455d83facbd02fcb4b80 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-3165dd57af4a455d83facbd02fcb4b80
I20260201 08:58:59.064085 15404 tablet_copy_source_session.cc:215] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:58:59.067207 16436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3165dd57af4a455d83facbd02fcb4b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:58:59.088641 16436 tablet_copy_client.cc:806] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:58:59.089388 16436 tablet_copy_client.cc:670] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:58:59.093387 16436 tablet_copy_client.cc:538] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:58:59.099857 16434 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:59.100886 16434 tablet_bootstrap.cc:492] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:59.101617 16434 ts_tablet_manager.cc:1403] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.050s user 0.019s sys 0.017s
I20260201 08:58:59.103847 16436 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:58:59.104540 16434 raft_consensus.cc:359] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.105588 16434 raft_consensus.cc:740] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:59.106267 16434 consensus_queue.cc:260] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.108927 16434 ts_tablet_manager.cc:1434] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260201 08:58:59.112466 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-8cce9e137d99477387581030f09ca781 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:58:59.112993 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-8cce9e137d99477387581030f09ca781 on tablet 8cce9e137d99477387581030f09ca781 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:59.136011 16436 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:58:59.137050 16436 tablet_bootstrap.cc:492] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:58:59.137787 16436 ts_tablet_manager.cc:1403] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.034s user 0.027s sys 0.000s
I20260201 08:58:59.140587 16436 raft_consensus.cc:359] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.141336 16436 raft_consensus.cc:740] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:58:59.142043 16436 consensus_queue.cc:260] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.144174 16436 ts_tablet_manager.cc:1434] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:58:59.146128 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-3165dd57af4a455d83facbd02fcb4b80 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:58:59.146519 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-3165dd57af4a455d83facbd02fcb4b80 on tablet 3165dd57af4a455d83facbd02fcb4b80 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:59.282636 15974 raft_consensus.cc:1217] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:59.334898 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:59.401026 15392 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:58:59.401569 15392 raft_consensus.cc:606] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:59.414168 15466 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:58:59.414626 15466 raft_consensus.cc:606] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:59.416908 15392 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:58:59.417472 15392 raft_consensus.cc:606] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:59.420640 15395 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:58:59.421217 15395 raft_consensus.cc:606] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:59.424892 15393 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:58:59.425345 15973 raft_consensus.cc:1217] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:59.425478 15393 raft_consensus.cc:606] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:58:59.430228 15393 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:58:59.430799 15393 raft_consensus.cc:606] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:58:59.434578 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260201 08:58:59.436192 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:58:59.437227 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:58:59.548632 15973 raft_consensus.cc:1217] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:59.560525 15973 raft_consensus.cc:1217] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:58:59.577913 16415 raft_consensus.cc:993] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:58:59.578473 16395 raft_consensus.cc:1081] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:58:59.580777 15320 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58728
I20260201 08:58:59.581377 15320 raft_consensus.cc:493] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:59.581754 15320 raft_consensus.cc:3060] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.586625 15320 raft_consensus.cc:515] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:59.588495 15320 leader_election.cc:290] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:59.588732 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:59.589408 15393 raft_consensus.cc:3060] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.589078 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4526578d0507494e9dd2e42783b20ab7" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:59.590225 15466 raft_consensus.cc:3055] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:59.590536 15466 raft_consensus.cc:740] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:58:59.591352 15466 consensus_queue.cc:260] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:59.592561 15466 raft_consensus.cc:3060] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.596424 15393 raft_consensus.cc:2468] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:58:59.597853 15284 leader_election.cc:304] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:59.598664 16396 raft_consensus.cc:2804] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:59.599246 15466 raft_consensus.cc:2468] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:58:59.600041 16396 raft_consensus.cc:697] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:59.601512 16396 consensus_queue.cc:237] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:59.612633 15217 catalog_manager.cc:5654] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:59.637497 16432 raft_consensus.cc:993] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:58:59.638770 16432 raft_consensus.cc:1081] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:58:59.641072 15320 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58734
I20260201 08:58:59.641665 15320 raft_consensus.cc:493] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:59.642004 15320 raft_consensus.cc:3060] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.648887 15320 raft_consensus.cc:515] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:59.650458 16393 raft_consensus.cc:993] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:58:59.651262 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:59.651803 15392 raft_consensus.cc:3055] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:59.652034 15320 leader_election.cc:290] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:59.652110 15392 raft_consensus.cc:740] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:59.652917 15392 consensus_queue.cc:260] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:59.654093 15392 raft_consensus.cc:3060] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.653472 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aff4e6978c594672a5ad5e2b9fe02d80" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:59.658424 15466 raft_consensus.cc:3060] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.658799 16393 raft_consensus.cc:1081] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:58:59.660308 15973 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:39782
I20260201 08:58:59.660810 15973 raft_consensus.cc:493] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:59.661266 15973 raft_consensus.cc:3060] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.663177 15392 raft_consensus.cc:2468] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:58:59.666407 16457 raft_consensus.cc:993] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:58:59.666882 16457 raft_consensus.cc:1081] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:58:59.666955 15284 leader_election.cc:304] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:58:59.667773 16396 raft_consensus.cc:2804] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:59.668202 16396 raft_consensus.cc:697] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:58:59.669238 16396 consensus_queue.cc:237] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:58:59.668394 15974 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:39782
I20260201 08:58:59.672096 15974 raft_consensus.cc:493] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:59.672444 15974 raft_consensus.cc:3060] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.673059 15973 raft_consensus.cc:515] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.675333 15973 leader_election.cc:290] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:59.676268 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:59.676820 15469 raft_consensus.cc:3060] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.677152 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "701bd49fcb3346a0873fe568317002e8" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:59.677642 15392 raft_consensus.cc:3055] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:59.677906 15392 raft_consensus.cc:740] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:59.680169 15392 consensus_queue.cc:260] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.681658 15392 raft_consensus.cc:3060] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.689639 15392 raft_consensus.cc:2468] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:58:59.690409 15469 raft_consensus.cc:2468] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:58:59.690816 15941 leader_election.cc:304] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:58:59.691800 16439 raft_consensus.cc:2804] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:59.692034 15974 raft_consensus.cc:515] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.693143 16439 raft_consensus.cc:697] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:58:59.694182 15466 raft_consensus.cc:2468] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:58:59.694068 16439 consensus_queue.cc:237] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.697295 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:59.698002 15392 raft_consensus.cc:3055] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:59.698272 15392 raft_consensus.cc:740] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:59.698829 15392 consensus_queue.cc:260] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.699556 15392 raft_consensus.cc:3060] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.703352 15974 leader_election.cc:290] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:58:59.704233 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c37d9e5e810f4cde8bf85667cc298883" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:58:59.704819 15469 raft_consensus.cc:3060] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.705030 15392 raft_consensus.cc:2468] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:58:59.704046 15217 catalog_manager.cc:5654] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:58:59.705857 15941 leader_election.cc:304] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:58:59.706835 16459 raft_consensus.cc:2804] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:59.713948 15218 catalog_manager.cc:5654] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:59.718389 15469 raft_consensus.cc:2468] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:58:59.720386 16415 raft_consensus.cc:1064] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:59.723109 16459 raft_consensus.cc:697] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:58:59.722734 16415 consensus_queue.cc:237] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.724031 16459 consensus_queue.cc:237] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.735999 15218 catalog_manager.cc:5654] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:59.740651 15974 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:59.742563 15392 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:59.742655 16450 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:59.743929 16414 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:59.747084 15316 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:59.748720 16395 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:59.809365 16395 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.811280 15392 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.811388 15974 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.825847 15218 catalog_manager.cc:5654] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.826033 15316 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.844533 15469 consensus_queue.cc:237] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.851013 15974 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:59.851341 16351 raft_consensus.cc:1064] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:58:59.852627 16415 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:59.853587 16351 consensus_queue.cc:237] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.854832 15316 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:58:59.856247 16415 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:58:59.861491 16414 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.867146 15977 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.870193 15320 raft_consensus.cc:2955] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.877642 15973 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:59.878150 15466 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:59.879278 16393 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:59.879588 16456 raft_consensus.cc:993] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:58:59.881326 16432 raft_consensus.cc:1081] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:58:59.882656 16457 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:58:59.885645 15973 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:39782
I20260201 08:58:59.886214 15973 raft_consensus.cc:493] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:59.886569 15973 raft_consensus.cc:3060] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.887960 15217 catalog_manager.cc:5654] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.891275 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 2914abdfc16e44c98c0e73c8c82e4c45 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:58:59.903585 15316 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:58:59.903970 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 2914abdfc16e44c98c0e73c8c82e4c45 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:58:59.905208 16456 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:58:59.919427 15973 raft_consensus.cc:515] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.925251 16471 tablet_replica.cc:333] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:58:59.928484 16456 raft_consensus.cc:993] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:58:59.930459 16456 raft_consensus.cc:1081] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:58:59.930876 15973 leader_election.cc:290] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:58:59.932243 15392 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:59.932497 15316 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58734
I20260201 08:58:59.932848 15392 raft_consensus.cc:3055] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:59.933180 15392 raft_consensus.cc:740] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:59.933599 15316 raft_consensus.cc:493] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:58:59.934866 15316 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.933917 15392 consensus_queue.cc:260] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.938730 15392 raft_consensus.cc:3060] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.934242 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74dd5038caeb4002a7029db349d2d5ea" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:58:59.941172 15313 raft_consensus.cc:3060] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.942171 16456 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.948232 15313 raft_consensus.cc:2468] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:58:59.950815 15974 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.951607 15465 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.954943 16471 raft_consensus.cc:2243] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:58:59.955672 16471 raft_consensus.cc:2272] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:58:59.958927 15316 raft_consensus.cc:515] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.961611 15393 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:58:59.962146 15393 raft_consensus.cc:3055] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:58:59.962414 15393 raft_consensus.cc:740] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:58:59.963059 15393 consensus_queue.cc:260] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:58:59.964387 15393 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:58:59.964294 15217 catalog_manager.cc:5654] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:58:59.964720 15320 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:58:59.971499 15943 leader_election.cc:304] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:58:59.973417 16459 raft_consensus.cc:2804] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:58:59.973905 16459 raft_consensus.cc:697] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:58:59.986496 15392 raft_consensus.cc:2468] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:58:59.990626 16471 ts_tablet_manager.cc:1916] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:58:59.974696 16459 consensus_queue.cc:237] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:58:59.998860 16426 raft_consensus.cc:1064] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:00.014163 16426 consensus_queue.cc:237] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:00.018585 15395 consensus_queue.cc:237] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:00.024704 15316 leader_election.cc:290] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:00.025921 15393 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:00.028527 15217 catalog_manager.cc:5654] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:00.032476 16471 ts_tablet_manager.cc:1929] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:00.033711 16471 log.cc:1199] T 2914abdfc16e44c98c0e73c8c82e4c45 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/2914abdfc16e44c98c0e73c8c82e4c45
I20260201 08:59:00.034906 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:00.035493 15469 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:00.039808 15974 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:00.043558 16393 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:00.043736 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 2914abdfc16e44c98c0e73c8c82e4c45 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:00.038403 15284 leader_election.cc:304] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:00.045823 16473 raft_consensus.cc:2804] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:00.046234 16473 raft_consensus.cc:697] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:00.046927 16473 consensus_queue.cc:237] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:00.050029 16351 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.075282 15974 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.086349 15467 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:00.088963 15467 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:00.094482 15469 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:00.097070 16478 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:00.097801 16457 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:00.104110 15469 raft_consensus.cc:2955] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.106257 15217 catalog_manager.cc:5654] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.113469 15389 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:00.116704 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6bd7a5722773409789e77823ae3e57e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:00.120502 15393 raft_consensus.cc:1275] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:00.133396 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet 6bd7a5722773409789e77823ae3e57e9 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:59:00.137087 15974 raft_consensus.cc:1275] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:00.141325 15469 raft_consensus.cc:1275] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:00.144236 16479 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:00.147483 15466 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:00.148662 16459 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:00.159965 15213 catalog_manager.cc:5654] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:00.163193 16478 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:00.170433 15393 raft_consensus.cc:1275] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:00.171358 16481 tablet_replica.cc:333] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:00.171802 16459 consensus_queue.cc:1048] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:00.174559 16481 raft_consensus.cc:2243] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:00.174728 15465 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:00.175729 16481 raft_consensus.cc:2272] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:00.176617 16478 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:00.179339 16481 ts_tablet_manager.cc:1916] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:00.184872 16479 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:00.188524 15389 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:00.186273 16473 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:00.206708 16479 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:00.273018 15392 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:00.273738 15467 raft_consensus.cc:1275] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:00.306839 16461 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260201 08:59:00.310040 16439 consensus_queue.cc:1048] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260201 08:59:00.351156 16396 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.319993 16481 ts_tablet_manager.cc:1929] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:00.360653 16481 log.cc:1199] T 6bd7a5722773409789e77823ae3e57e9 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/6bd7a5722773409789e77823ae3e57e9
W20260201 08:59:00.337149 15435 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:41253, user_credentials={real_user=slave}} blocked reactor thread for 71581.9us
I20260201 08:59:00.378186 15467 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.391357 15392 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.401808 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet 6bd7a5722773409789e77823ae3e57e9 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:00.440894 15391 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:00.454865 16500 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260201 08:59:00.488898 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:00.488353 15973 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.500559 15974 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Advancing to term 2
I20260201 08:59:00.488178 15218 catalog_manager.cc:5654] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.511544 15974 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:00.516058 16396 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260201 08:59:00.532456 15317 raft_consensus.cc:1275] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:00.534439 15392 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:00.541107 16396 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260201 08:59:00.575481 16500 consensus_queue.cc:1048] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260201 08:59:00.594615 15467 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:00.600337 16496 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260201 08:59:00.614879 15433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:45593, user_credentials={real_user=slave}} blocked reactor thread for 310015us
I20260201 08:59:00.655028 16426 raft_consensus.cc:1064] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:00.672078 16426 consensus_queue.cc:237] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:00.712921 15317 consensus_queue.cc:237] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:00.713315 15469 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:00.714227 15973 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:00.732349 15973 raft_consensus.cc:1275] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:00.735874 16479 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:00.737814 16396 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:00.750133 15393 raft_consensus.cc:1275] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:00.777724 16396 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260201 08:59:00.792505 15467 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:00.795562 15467 raft_consensus.cc:606] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:00.797760 15391 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:00.800344 16496 consensus_queue.cc:1048] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:00.811719 16426 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.816491 15975 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.819089 16473 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:00.828795 16473 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.829556 15389 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.838822 16497 raft_consensus.cc:993] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:00.839537 16516 raft_consensus.cc:1081] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:00.845244 15973 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.848035 15467 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:00.848655 15467 raft_consensus.cc:606] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:00.849002 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 8cce9e137d99477387581030f09ca781 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:00.853624 15467 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "43ebb725235944919ca48499c364ba78"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:00.854215 15467 raft_consensus.cc:606] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:00.857456 15393 raft_consensus.cc:2955] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.858354 15218 catalog_manager.cc:5654] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:00.864253 15317 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58728
I20260201 08:59:00.865461 15317 raft_consensus.cc:493] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:00.865803 15317 raft_consensus.cc:3060] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:00.862569 15213 catalog_manager.cc:5654] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.874024 15317 raft_consensus.cc:515] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:00.878317 15317 leader_election.cc:290] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:00.887326 16497 raft_consensus.cc:993] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:00.887859 16450 raft_consensus.cc:1081] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:00.889689 15391 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "43ebb725235944919ca48499c364ba78"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33098
I20260201 08:59:00.890265 15391 raft_consensus.cc:493] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:00.890599 15391 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:00.894698 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 8cce9e137d99477387581030f09ca781 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:59:00.894266 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:00.895857 15467 raft_consensus.cc:3055] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:00.896168 15467 raft_consensus.cc:740] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:00.896894 15467 consensus_queue.cc:260] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:00.898175 15467 raft_consensus.cc:3060] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:00.928086 15467 raft_consensus.cc:2468] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:00.939949 15286 leader_election.cc:304] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:00.941015 16396 raft_consensus.cc:2804] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:00.941517 16396 raft_consensus.cc:697] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:00.942451 16396 consensus_queue.cc:237] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:00.937229 15389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "243f1be44dc24698bb4e8556f40e21d3" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:00.944219 15389 raft_consensus.cc:3060] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:00.947808 16519 tablet_replica.cc:333] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:00.951056 15389 raft_consensus.cc:2468] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:00.957141 15467 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:00.963223 16519 raft_consensus.cc:2243] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:00.964083 16519 raft_consensus.cc:2272] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:00.973096 15391 raft_consensus.cc:515] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:00.969745 16519 ts_tablet_manager.cc:1916] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:00.976161 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:00.976725 15317 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:00.977368 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:00.977916 15469 raft_consensus.cc:3055] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:00.978214 15469 raft_consensus.cc:740] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:00.978873 15469 consensus_queue.cc:260] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:00.979928 15469 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:00.982858 15317 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:00.983448 15391 leader_election.cc:290] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:00.984017 15361 leader_election.cc:304] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:00.984994 16456 raft_consensus.cc:2804] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:00.985476 16456 raft_consensus.cc:697] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:00.986340 16456 consensus_queue.cc:237] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:00.989423 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:00.990046 15316 raft_consensus.cc:606] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:00.995587 15469 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:00.997120 15467 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:00.997728 15467 raft_consensus.cc:606] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:01.004693 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260201 08:59:01.006393 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:01.006188 15217 catalog_manager.cc:5654] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:01.007143 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:01.017050 16519 ts_tablet_manager.cc:1929] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:01.017802 16519 log.cc:1199] T 8cce9e137d99477387581030f09ca781 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/8cce9e137d99477387581030f09ca781
I20260201 08:59:01.019502 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 8cce9e137d99477387581030f09ca781 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:01.022372 15217 catalog_manager.cc:5654] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:01.043742 15316 consensus_queue.cc:237] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:01.060611 15973 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:01.071511 15391 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:01.078475 16479 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:01.080660 16479 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:01.095718 16396 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:01.098853 15391 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:01.103437 15973 raft_consensus.cc:2955] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:01.118901 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3165dd57af4a455d83facbd02fcb4b80 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:01.120828 15217 catalog_manager.cc:5654] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:01.138968 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 3165dd57af4a455d83facbd02fcb4b80 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40852
I20260201 08:59:01.139894 16519 tablet_replica.cc:333] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:01.140807 16519 raft_consensus.cc:2243] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:01.141613 16519 raft_consensus.cc:2272] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:01.144945 16519 ts_tablet_manager.cc:1916] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:01.157459 16519 ts_tablet_manager.cc:1929] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260201 08:59:01.157820 16519 log.cc:1199] T 3165dd57af4a455d83facbd02fcb4b80 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/3165dd57af4a455d83facbd02fcb4b80
I20260201 08:59:01.159399 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 3165dd57af4a455d83facbd02fcb4b80 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:01.173259 16396 raft_consensus.cc:993] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:01.173774 16426 raft_consensus.cc:1081] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:01.175812 15388 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33104
I20260201 08:59:01.176316 15388 raft_consensus.cc:493] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:01.176587 15388 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.181173 15388 raft_consensus.cc:515] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:01.182739 15388 leader_election.cc:290] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:01.183497 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:01.183779 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:01.184109 15316 raft_consensus.cc:3055] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:01.184319 15467 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.184463 15316 raft_consensus.cc:740] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:01.185288 15316 consensus_queue.cc:260] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:01.186446 15316 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.190537 15467 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:01.191623 15361 leader_election.cc:304] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:01.192556 16509 raft_consensus.cc:2804] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:01.192883 15316 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:01.193118 16509 raft_consensus.cc:697] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:01.194126 16509 consensus_queue.cc:237] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:01.212097 15216 catalog_manager.cc:5654] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:01.239114 16497 raft_consensus.cc:993] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:01.239614 16497 raft_consensus.cc:1081] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:01.241093 15973 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53064
I20260201 08:59:01.241629 15973 raft_consensus.cc:493] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:01.241957 15973 raft_consensus.cc:3060] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.247043 15973 raft_consensus.cc:515] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:01.248368 15973 leader_election.cc:290] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:01.249377 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:01.249285 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a58e5895d1541adabbfb02b14fa2735" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:01.249974 15467 raft_consensus.cc:3055] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:01.250134 15316 raft_consensus.cc:3060] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.250363 15467 raft_consensus.cc:740] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:01.251065 15467 consensus_queue.cc:260] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:01.252203 15467 raft_consensus.cc:3060] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.259339 15467 raft_consensus.cc:2468] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:01.260251 15943 leader_election.cc:304] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:01.261040 16500 raft_consensus.cc:2804] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:01.260627 15316 raft_consensus.cc:2468] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:01.261582 16500 raft_consensus.cc:697] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:01.262441 16500 consensus_queue.cc:237] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:01.271500 15216 catalog_manager.cc:5654] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:01.286763 16497 raft_consensus.cc:993] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:01.287248 16450 raft_consensus.cc:1081] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:01.288591 15313 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58728
I20260201 08:59:01.289143 15313 raft_consensus.cc:493] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:01.289422 15313 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.295133 15313 raft_consensus.cc:515] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:01.296697 15313 leader_election.cc:290] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:01.297493 15388 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:01.297945 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:01.298262 15388 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.298514 15467 raft_consensus.cc:3055] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:01.298858 15467 raft_consensus.cc:740] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:01.299577 15467 consensus_queue.cc:260] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:01.300768 15467 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:01.306185 15467 raft_consensus.cc:2468] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:01.306277 15388 raft_consensus.cc:2468] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:01.307526 15284 leader_election.cc:304] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:01.308452 16396 raft_consensus.cc:2804] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:01.308815 16396 raft_consensus.cc:697] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:01.309535 16396 consensus_queue.cc:237] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:01.320677 15216 catalog_manager.cc:5654] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:01.396481 15388 raft_consensus.cc:1275] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.397601 16396 consensus_queue.cc:1048] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.403779 15313 raft_consensus.cc:1275] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.405084 16457 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.410665 15467 raft_consensus.cc:1275] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.412266 16396 consensus_queue.cc:1048] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.425280 15469 raft_consensus.cc:1275] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.426945 16456 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.718379 15316 raft_consensus.cc:1275] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.719571 16509 consensus_queue.cc:1048] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.726917 15469 raft_consensus.cc:1275] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.728538 16457 consensus_queue.cc:1048] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.734540 15391 raft_consensus.cc:1275] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.736047 16478 consensus_queue.cc:1048] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.748997 15469 raft_consensus.cc:1275] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:01.750198 16426 consensus_queue.cc:1048] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:01.878118 15316 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:01.879161 16500 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:01.884143 15467 raft_consensus.cc:1275] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:01.886307 16500 consensus_queue.cc:1048] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:02.088550 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:02.133453 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:02.133925 15316 raft_consensus.cc:606] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:02.136194 15467 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:02.136757 15467 raft_consensus.cc:606] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:02.138870 15388 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "43ebb725235944919ca48499c364ba78"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:02.139634 15388 raft_consensus.cc:606] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:02.141840 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:02.142311 15316 raft_consensus.cc:606] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:02.144363 15388 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:02.144789 15388 raft_consensus.cc:606] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:02.145769 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260201 08:59:02.147043 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:02.147586 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:02.199685 15388 consensus_queue.cc:237] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.205155 15467 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:02.205472 15316 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:59:02.205832 15359 consensus_peers.cc:597] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15ac6b4592d14c9085fa39e7b3613e9b. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:02.206622 16537 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:02.207535 16456 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:02.214815 16537 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.216424 15467 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.216629 15316 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.233129 15469 consensus_queue.cc:237] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.232612 15217 catalog_manager.cc:5654] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.244822 15316 raft_consensus.cc:1275] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:59:02.245698 15433 consensus_peers.cc:597] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17706b520675450192459a881b96a1ce. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:02.246302 16450 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:02.246681 15388 raft_consensus.cc:1275] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:02.248111 16497 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:02.254168 16457 raft_consensus.cc:993] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:02.254688 16457 raft_consensus.cc:1081] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:02.256282 15313 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "43ebb725235944919ca48499c364ba78"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58734
I20260201 08:59:02.256830 15313 raft_consensus.cc:493] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:02.257221 15313 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:02.268405 15313 raft_consensus.cc:515] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.284255 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:02.285538 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:02.286196 15391 raft_consensus.cc:3055] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:02.286512 15391 raft_consensus.cc:740] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:02.287266 15391 consensus_queue.cc:260] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.288461 15391 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:02.290728 16497 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.293829 15469 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:02.295892 15391 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 3.
I20260201 08:59:02.297314 15284 leader_election.cc:304] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:02.298178 16479 raft_consensus.cc:2804] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:02.297959 15393 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.298751 16479 raft_consensus.cc:697] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:02.305368 16479 consensus_queue.cc:237] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.310621 15313 leader_election.cc:290] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 3 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:02.328796 15469 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 3.
I20260201 08:59:02.337267 15316 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.341645 15469 consensus_queue.cc:237] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:59:02.351408 15433 consensus_peers.cc:597] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: baa1e353775e4af5a659c0d25dc5d48b. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:02.353603 15312 raft_consensus.cc:1275] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:02.355129 16450 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:02.356361 15393 raft_consensus.cc:1275] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:02.357697 16533 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:02.358825 15216 catalog_manager.cc:5654] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 2 to 3, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 3 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:02.356276 15218 catalog_manager.cc:5654] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.391835 16533 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.393440 15393 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.397760 16478 raft_consensus.cc:993] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:02.398254 16478 raft_consensus.cc:1081] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:02.399881 15976 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53080
I20260201 08:59:02.400418 15976 raft_consensus.cc:493] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:02.400758 15976 raft_consensus.cc:3060] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.410120 15218 catalog_manager.cc:5654] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.410764 15976 raft_consensus.cc:515] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:02.414338 15976 leader_election.cc:290] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:02.415638 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:02.415987 15312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c11524c3a8704cfdba261441ff2bed79" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:02.416222 15469 raft_consensus.cc:3060] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.416661 15312 raft_consensus.cc:3055] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:02.416998 15312 raft_consensus.cc:740] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:02.417672 15312 consensus_queue.cc:260] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:02.418795 15312 raft_consensus.cc:3060] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.420881 15316 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.423421 15469 raft_consensus.cc:2468] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:02.424580 15943 leader_election.cc:304] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:02.425377 16540 raft_consensus.cc:2804] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:02.425375 15312 raft_consensus.cc:2468] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:02.425987 16540 raft_consensus.cc:697] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:02.426812 16540 consensus_queue.cc:237] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:02.427088 15393 consensus_queue.cc:237] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.437072 15218 catalog_manager.cc:5654] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:02.454064 15469 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:02.455502 16456 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260201 08:59:02.457185 15359 consensus_peers.cc:597] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70006ed087454f3d92664b9822397752. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:02.457700 15316 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:02.458810 16456 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:02.462127 16537 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.463858 15469 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.468286 15316 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:02.478725 15213 catalog_manager.cc:5654] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:02.584228 16509 raft_consensus.cc:993] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:02.584709 16457 raft_consensus.cc:1081] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:02.586097 15316 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58734
I20260201 08:59:02.586608 15316 raft_consensus.cc:493] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:02.586939 15316 raft_consensus.cc:3060] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.590447 16450 raft_consensus.cc:993] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:02.590945 16533 raft_consensus.cc:1081] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:02.592231 15388 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33098
I20260201 08:59:02.592814 15388 raft_consensus.cc:493] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:02.593328 15388 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.592628 15316 raft_consensus.cc:515] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.595371 15316 leader_election.cc:290] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:02.597819 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:02.598143 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e55acce968e24f25b46b388a4fc2c773" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:02.598712 15391 raft_consensus.cc:3055] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:02.599027 15391 raft_consensus.cc:740] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:02.599757 15391 consensus_queue.cc:260] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.600669 15391 raft_consensus.cc:3060] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.598392 15469 raft_consensus.cc:3060] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.601946 15388 raft_consensus.cc:515] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.604732 16561 ts_tablet_manager.cc:933] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:02.606128 15388 leader_election.cc:290] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:02.607687 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:02.608194 15467 raft_consensus.cc:3055] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:02.608450 15467 raft_consensus.cc:740] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:02.609150 15467 consensus_queue.cc:260] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.609516 16479 raft_consensus.cc:993] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:02.610052 16479 raft_consensus.cc:1081] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:02.610208 15467 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.611027 15391 raft_consensus.cc:2468] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:02.612107 15284 leader_election.cc:304] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:02.612411 15469 raft_consensus.cc:2468] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:02.613031 15976 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53080
I20260201 08:59:02.609794 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:02.613646 15976 raft_consensus.cc:493] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:02.614096 15976 raft_consensus.cc:3060] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.613679 15316 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.616730 16479 raft_consensus.cc:2804] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:02.617146 15467 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:02.617206 16479 raft_consensus.cc:697] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:02.618130 16479 consensus_queue.cc:237] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.619839 15361 leader_election.cc:304] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:02.620558 16457 raft_consensus.cc:2804] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:02.621016 16457 raft_consensus.cc:697] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:02.621632 16457 consensus_queue.cc:237] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:02.626009 15316 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:02.628122 15976 raft_consensus.cc:515] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:02.631078 15976 leader_election.cc:290] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:02.631268 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:02.632200 15316 raft_consensus.cc:3055] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:02.632542 15316 raft_consensus.cc:740] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:02.634645 15388 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1a6f3a1022c04fbea745045247de85a4" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:02.635361 15388 raft_consensus.cc:3060] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.633983 15316 consensus_queue.cc:260] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:02.639075 15316 raft_consensus.cc:3060] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:02.636761 16565 ts_tablet_manager.cc:933] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:02.646394 16561 tablet_copy_client.cc:323] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:59:02.648124 16565 tablet_copy_client.cc:323] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:59:02.649214 15213 catalog_manager.cc:5654] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:02.654058 15388 raft_consensus.cc:2468] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:02.655063 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 15ac6b4592d14c9085fa39e7b3613e9b from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:59:02.655599 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 15ac6b4592d14c9085fa39e7b3613e9b from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-15ac6b4592d14c9085fa39e7b3613e9b
I20260201 08:59:02.656008 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet 17706b520675450192459a881b96a1ce from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:59:02.656539 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet 17706b520675450192459a881b96a1ce from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-17706b520675450192459a881b96a1ce
I20260201 08:59:02.657205 15941 leader_election.cc:304] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:02.658320 16540 raft_consensus.cc:2804] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:02.658769 16540 raft_consensus.cc:697] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:02.659543 16540 consensus_queue.cc:237] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:02.661114 15316 raft_consensus.cc:2468] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:02.663600 15404 tablet_copy_source_session.cc:215] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:02.671156 16561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15ac6b4592d14c9085fa39e7b3613e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:02.652215 15218 catalog_manager.cc:5654] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:02.688155 15216 catalog_manager.cc:5654] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:02.695708 15479 tablet_copy_source_session.cc:215] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:02.693629 16561 tablet_copy_client.cc:806] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:02.699409 16561 tablet_copy_client.cc:670] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:02.706640 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17706b520675450192459a881b96a1ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:02.711438 16561 tablet_copy_client.cc:538] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:02.720580 16561 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:02.723738 16565 tablet_copy_client.cc:806] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:02.724431 16565 tablet_copy_client.cc:670] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:02.729331 16565 tablet_copy_client.cc:538] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:02.731015 15469 raft_consensus.cc:1275] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:02.732368 16426 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:02.748793 16565 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:02.764303 16561 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:02.765498 16561 tablet_bootstrap.cc:492] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:02.768769 16561 ts_tablet_manager.cc:1403] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.048s user 0.025s sys 0.008s
I20260201 08:59:02.771900 16561 raft_consensus.cc:359] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.773052 16561 raft_consensus.cc:740] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:02.776070 16561 consensus_queue.cc:260] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.782537 16561 ts_tablet_manager.cc:1434] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260201 08:59:02.784098 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-15ac6b4592d14c9085fa39e7b3613e9b received from {username='slave'} at 127.0.0.1:36982
I20260201 08:59:02.784612 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-15ac6b4592d14c9085fa39e7b3613e9b on tablet 15ac6b4592d14c9085fa39e7b3613e9b with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:02.794150 16570 ts_tablet_manager.cc:933] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:02.800200 15388 raft_consensus.cc:1275] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:02.802564 16479 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:02.802961 16565 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:02.804005 16565 tablet_bootstrap.cc:492] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:02.804832 16565 ts_tablet_manager.cc:1403] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.056s user 0.026s sys 0.020s
I20260201 08:59:02.807669 16565 raft_consensus.cc:359] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.808619 16565 raft_consensus.cc:740] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:02.809363 16565 consensus_queue.cc:260] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.814911 16565 ts_tablet_manager.cc:1434] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
I20260201 08:59:02.816987 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-17706b520675450192459a881b96a1ce received from {username='slave'} at 127.0.0.1:40888
I20260201 08:59:02.817487 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-17706b520675450192459a881b96a1ce on tablet 17706b520675450192459a881b96a1ce with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:02.820609 16570 tablet_copy_client.cc:323] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:59:02.823006 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet baa1e353775e4af5a659c0d25dc5d48b from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:59:02.823546 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet baa1e353775e4af5a659c0d25dc5d48b from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-baa1e353775e4af5a659c0d25dc5d48b
I20260201 08:59:02.831144 15479 tablet_copy_source_session.cc:215] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:02.843436 16570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa1e353775e4af5a659c0d25dc5d48b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:02.866096 16570 tablet_copy_client.cc:806] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:02.866657 16570 tablet_copy_client.cc:670] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:02.870388 16570 tablet_copy_client.cc:538] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:02.878578 16570 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:02.900560 16565 ts_tablet_manager.cc:933] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:02.903008 16570 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:02.903920 16570 tablet_bootstrap.cc:492] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:02.904736 16570 ts_tablet_manager.cc:1403] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.026s user 0.018s sys 0.004s
I20260201 08:59:02.908134 16570 raft_consensus.cc:359] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.909227 16570 raft_consensus.cc:740] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:02.910002 16570 consensus_queue.cc:260] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:02.915588 16565 tablet_copy_client.cc:323] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:59:02.916224 16570 ts_tablet_manager.cc:1434] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.011s user 0.003s sys 0.004s
I20260201 08:59:02.917297 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 70006ed087454f3d92664b9822397752 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:59:02.917836 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 70006ed087454f3d92664b9822397752 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-70006ed087454f3d92664b9822397752
I20260201 08:59:02.920436 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-baa1e353775e4af5a659c0d25dc5d48b received from {username='slave'} at 127.0.0.1:40888
I20260201 08:59:02.920790 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-baa1e353775e4af5a659c0d25dc5d48b on tablet baa1e353775e4af5a659c0d25dc5d48b with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:02.924106 15404 tablet_copy_source_session.cc:215] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:02.930292 16565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70006ed087454f3d92664b9822397752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:02.944399 15312 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:02.945557 15467 raft_consensus.cc:1275] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:02.945878 16565 tablet_copy_client.cc:806] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:02.946493 16565 tablet_copy_client.cc:670] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:02.946740 16541 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:02.947813 16540 consensus_queue.cc:1048] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:02.952445 16565 tablet_copy_client.cc:538] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:02.964429 16565 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:03.004895 16565 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:03.005832 16565 tablet_bootstrap.cc:492] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:03.006567 16565 ts_tablet_manager.cc:1403] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.042s user 0.021s sys 0.001s
I20260201 08:59:03.008643 15466 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:03.014567 16426 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:03.014914 16565 raft_consensus.cc:359] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:03.015733 16565 raft_consensus.cc:740] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:03.016438 16565 consensus_queue.cc:260] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:03.021736 16565 ts_tablet_manager.cc:1434] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.015s user 0.003s sys 0.003s
I20260201 08:59:03.024291 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-70006ed087454f3d92664b9822397752 received from {username='slave'} at 127.0.0.1:36982
I20260201 08:59:03.024734 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-70006ed087454f3d92664b9822397752 on tablet 70006ed087454f3d92664b9822397752 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:03.033463 15976 raft_consensus.cc:1217] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:03.043056 15976 raft_consensus.cc:1217] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:03.046881 15312 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:03.048220 16541 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:03.058015 15388 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:03.061658 15316 raft_consensus.cc:1275] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:03.063436 16537 consensus_queue.cc:1048] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:03.072326 16585 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:03.087170 15389 raft_consensus.cc:1275] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:03.091596 16541 consensus_queue.cc:1048] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:03.135785 15467 raft_consensus.cc:1275] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:03.137486 16537 consensus_queue.cc:1048] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:03.188156 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:03.234061 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:03.234658 15469 raft_consensus.cc:606] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:03.237994 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:03.238507 15316 raft_consensus.cc:606] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:03.241252 15391 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:03.241740 15391 raft_consensus.cc:606] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:03.244014 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "de818d695150438d84ff5feff7a448c6"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:03.244508 15469 raft_consensus.cc:606] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:03.246759 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:03.247287 15316 raft_consensus.cc:606] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:03.248299 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260201 08:59:03.249843 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:03.250669 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:03.300681 15973 raft_consensus.cc:1217] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:03.364342 16478 raft_consensus.cc:993] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:03.364789 16426 raft_consensus.cc:1081] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:03.366258 15973 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53080
I20260201 08:59:03.366777 15973 raft_consensus.cc:493] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:03.367136 15973 raft_consensus.cc:3060] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.371767 15973 raft_consensus.cc:515] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.373934 15973 leader_election.cc:290] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:03.375051 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:03.375631 15316 raft_consensus.cc:3055] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:03.375803 15973 raft_consensus.cc:1217] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:03.375946 15316 raft_consensus.cc:740] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:03.379288 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "611e2cdf949d4159bce7bcd1606d9604" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:03.380182 15469 raft_consensus.cc:3060] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.376669 15316 consensus_queue.cc:260] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.382886 15316 raft_consensus.cc:3060] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.385339 15469 raft_consensus.cc:2468] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:03.386322 15943 leader_election.cc:304] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:03.387104 16540 raft_consensus.cc:2804] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:03.387580 16540 raft_consensus.cc:697] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:03.388362 16540 consensus_queue.cc:237] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.389015 15316 raft_consensus.cc:2468] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:03.410949 15216 catalog_manager.cc:5654] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:03.471108 16497 raft_consensus.cc:993] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:03.471504 16533 raft_consensus.cc:1081] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:03.472813 15316 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "de818d695150438d84ff5feff7a448c6"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58728
I20260201 08:59:03.473263 15316 raft_consensus.cc:493] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:03.473547 15316 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.478555 15316 raft_consensus.cc:515] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:03.479835 15316 leader_election.cc:290] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:03.480525 15388 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:03.481057 15388 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.480710 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:03.481598 15467 raft_consensus.cc:3055] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:03.481886 15467 raft_consensus.cc:740] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:03.482450 15467 consensus_queue.cc:260] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:03.483932 15467 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.490664 15467 raft_consensus.cc:2468] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:03.495544 15388 raft_consensus.cc:2468] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:03.532907 16456 raft_consensus.cc:1064] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:03.536140 16456 consensus_queue.cc:237] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.539533 15286 leader_election.cc:304] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:03.542606 16585 raft_consensus.cc:2804] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:03.543100 16585 raft_consensus.cc:697] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:03.543941 16585 consensus_queue.cc:237] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:03.554821 15973 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.556010 15312 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.557806 16457 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.569766 16537 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.571547 15467 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.574039 15216 catalog_manager.cc:5654] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:03.579536 16456 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.586513 16450 raft_consensus.cc:1064] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:03.588980 16450 consensus_queue.cc:237] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.598100 15973 raft_consensus.cc:1275] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.600689 16497 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.604609 15388 raft_consensus.cc:1275] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260201 08:59:03.605120 15284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:45593, user_credentials={real_user=slave}} blocked reactor thread for 47661us
I20260201 08:59:03.611758 16533 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:03.612874 15316 raft_consensus.cc:1275] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.625762 16601 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.625622 16537 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.628376 15316 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.634645 15469 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.636615 16597 raft_consensus.cc:993] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:03.637108 16597 raft_consensus.cc:1081] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:03.638598 16601 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.640307 16497 raft_consensus.cc:993] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:03.641023 16533 raft_consensus.cc:1081] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:03.643452 15976 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53064
I20260201 08:59:03.644493 15976 raft_consensus.cc:493] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:03.643713 15975 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.644831 15976 raft_consensus.cc:3060] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.654266 15976 raft_consensus.cc:515] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.654695 15216 catalog_manager.cc:5654] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.656029 15976 leader_election.cc:290] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:03.659998 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:03.660527 15467 raft_consensus.cc:3055] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:03.660820 15467 raft_consensus.cc:740] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:03.661478 15467 consensus_queue.cc:260] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.663139 15389 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33104
I20260201 08:59:03.663478 15467 raft_consensus.cc:3060] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.663749 15389 raft_consensus.cc:493] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:03.664203 15389 raft_consensus.cc:3060] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.669792 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "491c0efe7c624b5f98f4894361bf6e68" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:03.672371 15389 raft_consensus.cc:515] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:03.673228 15391 raft_consensus.cc:3060] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.673574 16457 raft_consensus.cc:993] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:03.675149 16457 raft_consensus.cc:1081] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:03.676601 15974 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:39782
I20260201 08:59:03.677129 15974 raft_consensus.cc:493] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:03.677484 15974 raft_consensus.cc:3060] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.678201 15389 leader_election.cc:290] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:03.679839 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:03.680490 15316 raft_consensus.cc:3055] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:03.681404 15316 raft_consensus.cc:740] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:03.682864 15316 consensus_queue.cc:260] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:03.685170 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ecb583266e43b38c0deee2e253c52f" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:03.688228 15218 catalog_manager.cc:5654] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.690002 15466 raft_consensus.cc:3060] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.690143 15316 raft_consensus.cc:3060] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.698433 15974 raft_consensus.cc:515] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.696275 15316 raft_consensus.cc:2468] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:03.674077 15973 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.701535 15361 leader_election.cc:304] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:03.702280 16457 raft_consensus.cc:2804] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:03.702744 16457 raft_consensus.cc:697] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:03.703547 16457 consensus_queue.cc:237] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:03.696275 15466 raft_consensus.cc:2468] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:03.709101 15389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:03.710485 15389 raft_consensus.cc:3055] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:03.710852 15389 raft_consensus.cc:740] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:03.711694 15389 consensus_queue.cc:260] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.709946 15467 raft_consensus.cc:2468] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:03.712982 15389 raft_consensus.cc:3060] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.713780 15943 leader_election.cc:304] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:03.714723 16541 raft_consensus.cc:2804] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:03.715049 15391 raft_consensus.cc:2468] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:03.714154 15312 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.715216 16541 raft_consensus.cc:697] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:03.718597 16541 consensus_queue.cc:237] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.721361 15388 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.737394 15389 raft_consensus.cc:2468] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:03.740994 15389 consensus_queue.cc:237] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.742213 15974 leader_election.cc:290] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:03.745167 15941 leader_election.cc:304] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:03.748816 16541 raft_consensus.cc:2804] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:03.749316 16541 raft_consensus.cc:697] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:03.750053 16541 consensus_queue.cc:237] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.751652 15213 catalog_manager.cc:5654] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:03.753746 15974 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:03.755685 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bd7a5722773409789e77823ae3e57e9" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:03.756220 15467 raft_consensus.cc:3060] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:03.756534 15466 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:03.761339 15467 raft_consensus.cc:2468] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:03.761212 15466 consensus_queue.cc:237] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.763590 16457 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:03.766137 16457 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:03.767735 15974 raft_consensus.cc:1275] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:03.770735 15312 raft_consensus.cc:1275] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:03.772459 16533 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:03.772284 16605 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.774544 15217 catalog_manager.cc:5654] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:03.776300 15217 catalog_manager.cc:5654] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:03.784464 15976 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.785053 16533 consensus_queue.cc:1048] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:03.790684 16497 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.808580 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 17706b520675450192459a881b96a1ce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:03.809506 15974 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.798863 15312 raft_consensus.cc:2955] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.812180 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 15ac6b4592d14c9085fa39e7b3613e9b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:03.809438 15218 catalog_manager.cc:5654] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:03.818864 15217 catalog_manager.cc:5654] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:03.823766 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet 15ac6b4592d14c9085fa39e7b3613e9b with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:59:03.832007 15466 raft_consensus.cc:2955] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.847303 16611 tablet_replica.cc:333] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:03.851650 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 17706b520675450192459a881b96a1ce with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:59:03.852728 16611 raft_consensus.cc:2243] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:03.853433 16611 raft_consensus.cc:2272] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:03.857697 16450 raft_consensus.cc:1064] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:03.861878 16450 consensus_queue.cc:237] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.867527 16611 ts_tablet_manager.cc:1916] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:03.874444 15312 raft_consensus.cc:1275] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.875977 16497 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.876411 15976 raft_consensus.cc:1275] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.878782 16457 raft_consensus.cc:1064] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:03.885705 16457 consensus_queue.cc:237] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.882716 15388 raft_consensus.cc:1275] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.890821 16611 ts_tablet_manager.cc:1929] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:03.891350 16611 log.cc:1199] T 15ac6b4592d14c9085fa39e7b3613e9b P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/15ac6b4592d14c9085fa39e7b3613e9b
I20260201 08:59:03.891253 16606 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:03.893690 16612 tablet_replica.cc:333] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:03.893505 16497 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.893965 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet 15ac6b4592d14c9085fa39e7b3613e9b (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:03.896294 16612 raft_consensus.cc:2243] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:03.897059 16612 raft_consensus.cc:2272] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:03.902483 16612 ts_tablet_manager.cc:1916] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:03.919991 16450 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.925516 15312 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.925019 15976 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.925392 15974 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.925380 15388 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.927279 16537 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.928071 16456 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.940526 15466 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:03.941797 15218 catalog_manager.cc:5654] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.944139 16537 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:03.958297 15317 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.981033 16537 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.982810 15312 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.984885 15467 consensus_queue.cc:237] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:03.991698 15974 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:03.995002 16612 ts_tablet_manager.cc:1929] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:03.995285 15976 raft_consensus.cc:1275] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:03.995456 16612 log.cc:1199] T 17706b520675450192459a881b96a1ce P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/17706b520675450192459a881b96a1ce
I20260201 08:59:03.997673 16601 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:03.998726 15388 raft_consensus.cc:1275] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:04.002183 16601 consensus_queue.cc:1048] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:04.004412 15466 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:04.005024 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 17706b520675450192459a881b96a1ce (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:04.006531 15317 raft_consensus.cc:1275] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:04.007453 15218 catalog_manager.cc:5654] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:04.009105 16541 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:04.011199 16606 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.018112 16541 consensus_queue.cc:1048] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:04.017917 15973 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.032133 15388 raft_consensus.cc:2955] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.040208 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet baa1e353775e4af5a659c0d25dc5d48b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:04.039942 15465 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.051162 15466 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:04.053138 16597 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:04.062907 15213 catalog_manager.cc:5654] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:04.103554 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet baa1e353775e4af5a659c0d25dc5d48b with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:59:04.105628 16611 tablet_replica.cc:333] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:04.110837 15388 consensus_queue.cc:237] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:04.118729 15389 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:04.119411 15976 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:04.120499 16597 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:04.120704 15317 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:04.120757 16457 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:04.122326 16537 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:04.128607 16605 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.142513 15317 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.152518 15389 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:04.154003 16541 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:04.153632 15976 raft_consensus.cc:2955] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.160662 16611 raft_consensus.cc:2243] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:04.169026 16611 raft_consensus.cc:2272] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:04.173086 16611 ts_tablet_manager.cc:1916] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:04.179658 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 70006ed087454f3d92664b9822397752 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:04.183954 15216 catalog_manager.cc:5654] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:04.190567 15469 raft_consensus.cc:1275] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:04.198698 16587 consensus_queue.cc:1048] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:04.200181 15317 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:04.200260 15469 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:04.201932 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 70006ed087454f3d92664b9822397752 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:59:04.211397 16456 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:04.212715 16456 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:04.220494 16611 ts_tablet_manager.cc:1929] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:04.220935 16611 log.cc:1199] T baa1e353775e4af5a659c0d25dc5d48b P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/baa1e353775e4af5a659c0d25dc5d48b
I20260201 08:59:04.229995 16630 tablet_replica.cc:333] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:04.235925 16630 raft_consensus.cc:2243] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:04.236893 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet baa1e353775e4af5a659c0d25dc5d48b (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:04.236886 16630 raft_consensus.cc:2272] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:04.254084 15389 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:04.255754 16587 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:04.284835 16630 ts_tablet_manager.cc:1916] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:04.298419 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:04.297901 15469 raft_consensus.cc:1275] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:04.303489 16587 consensus_queue.cc:1048] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:04.306223 16630 ts_tablet_manager.cc:1929] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:04.306737 16630 log.cc:1199] T 70006ed087454f3d92664b9822397752 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/70006ed087454f3d92664b9822397752
I20260201 08:59:04.308630 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 70006ed087454f3d92664b9822397752 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:04.347165 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:04.347679 15469 raft_consensus.cc:606] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:04.350070 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:04.350616 15469 raft_consensus.cc:606] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:04.353487 15388 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:04.354028 15388 raft_consensus.cc:606] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:04.356050 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:04.356454 15469 raft_consensus.cc:606] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:04.358301 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:04.358767 15316 raft_consensus.cc:606] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:04.359740 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260201 08:59:04.361409 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:04.361969 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:04.447328 16478 raft_consensus.cc:993] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:04.447790 16426 raft_consensus.cc:1081] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:04.449141 15388 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33104
I20260201 08:59:04.449571 15388 raft_consensus.cc:493] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:04.449859 15388 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:04.454543 15388 raft_consensus.cc:515] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.456004 15388 leader_election.cc:290] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 3 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:04.456933 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:04.457508 15466 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:04.457875 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f5d6cd697b47e9902f4fc7e8b5f02d" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:04.460668 15316 raft_consensus.cc:3055] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:04.461038 15316 raft_consensus.cc:740] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:04.461640 15316 consensus_queue.cc:260] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.462538 15316 raft_consensus.cc:3060] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:04.464291 15466 raft_consensus.cc:2468] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 3.
I20260201 08:59:04.465224 15361 leader_election.cc:304] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:04.465777 16537 raft_consensus.cc:2804] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:04.466133 16537 raft_consensus.cc:697] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 3 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:04.467398 15316 raft_consensus.cc:2468] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 3.
I20260201 08:59:04.467370 16537 consensus_queue.cc:237] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.476775 15213 catalog_manager.cc:5654] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 2 to 3, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 3 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:04.693979 16605 raft_consensus.cc:993] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:04.694469 16537 raft_consensus.cc:1081] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:04.695900 15316 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58734
I20260201 08:59:04.696419 15316 raft_consensus.cc:493] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:04.696749 15316 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:04.704355 15316 raft_consensus.cc:515] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.706585 15316 leader_election.cc:290] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 3 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:04.706909 15389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:04.707072 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ae8b0c2714e8985023ed0c9603d2a" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:04.707537 15389 raft_consensus.cc:3055] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:04.707767 15466 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:04.707880 15389 raft_consensus.cc:740] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:04.708580 15389 consensus_queue.cc:260] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.709595 15389 raft_consensus.cc:3060] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:04.713325 15466 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 3.
I20260201 08:59:04.714316 15286 leader_election.cc:304] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:04.714974 16426 raft_consensus.cc:2804] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:04.714991 15389 raft_consensus.cc:2468] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 3.
I20260201 08:59:04.715483 16426 raft_consensus.cc:697] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:04.716267 16426 consensus_queue.cc:237] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.725407 15213 catalog_manager.cc:5654] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 2 to 3, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 3 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:04.801728 16606 raft_consensus.cc:993] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:04.802129 16601 raft_consensus.cc:1081] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:04.803397 15974 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53064
I20260201 08:59:04.803864 15974 raft_consensus.cc:493] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:04.804185 15974 raft_consensus.cc:3060] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.805271 16601 raft_consensus.cc:993] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:04.805724 16606 raft_consensus.cc:1081] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:04.806908 15317 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58728
I20260201 08:59:04.807395 15317 raft_consensus.cc:493] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:04.807715 15317 raft_consensus.cc:3060] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.810655 15974 raft_consensus.cc:515] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:04.812500 15974 leader_election.cc:290] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:04.814090 15317 raft_consensus.cc:515] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.815848 15317 leader_election.cc:290] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:04.817201 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:04.817489 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:04.817797 15469 raft_consensus.cc:3055] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:04.817760 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2914abdfc16e44c98c0e73c8c82e4c45" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:04.818079 15465 raft_consensus.cc:3055] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:04.818322 15469 raft_consensus.cc:740] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:04.818516 15316 raft_consensus.cc:3060] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.819094 15469 consensus_queue.cc:260] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:04.820307 15469 raft_consensus.cc:3060] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.822391 15389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdb7fc00ac24ebc843ae2a3fe089389" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:04.822903 15389 raft_consensus.cc:3060] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.825585 15316 raft_consensus.cc:2468] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:04.826428 15465 raft_consensus.cc:740] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:04.826678 15943 leader_election.cc:304] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:04.827404 16587 raft_consensus.cc:2804] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:04.827174 15465 consensus_queue.cc:260] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.827883 16587 raft_consensus.cc:697] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:04.828336 15465 raft_consensus.cc:3060] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.828902 15389 raft_consensus.cc:2468] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:04.828729 16587 consensus_queue.cc:237] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:04.836593 15284 leader_election.cc:304] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:04.837308 16478 raft_consensus.cc:2804] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:04.838318 15213 catalog_manager.cc:5654] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:04.844399 16478 raft_consensus.cc:697] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:04.845391 16478 consensus_queue.cc:237] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.851595 15469 raft_consensus.cc:2468] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:04.844054 15465 raft_consensus.cc:2468] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:04.864495 16606 raft_consensus.cc:993] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:04.865046 16606 raft_consensus.cc:1081] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:04.868163 15389 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33098
I20260201 08:59:04.868752 15389 raft_consensus.cc:493] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:04.869109 15389 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.873432 15218 catalog_manager.cc:5654] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:04.879144 15389 raft_consensus.cc:515] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.885028 15389 leader_election.cc:290] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:04.886806 15465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:04.887359 15465 raft_consensus.cc:3055] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:04.887656 15465 raft_consensus.cc:740] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:04.888986 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:04.889539 15317 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.889873 15465 consensus_queue.cc:260] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.891062 15465 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:04.896145 15317 raft_consensus.cc:2468] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:04.897194 15361 leader_election.cc:304] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:04.898272 15465 raft_consensus.cc:2468] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:04.898728 16605 raft_consensus.cc:2804] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:04.899279 16605 raft_consensus.cc:697] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
W20260201 08:59:04.899291 15284 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:37119, user_credentials={real_user=slave}} blocked reactor thread for 61643us
I20260201 08:59:04.900226 16605 consensus_queue.cc:237] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:04.924362 15465 raft_consensus.cc:1275] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:04.923935 15218 catalog_manager.cc:5654] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:04.925688 16605 consensus_queue.cc:1048] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:04.954811 15317 raft_consensus.cc:1275] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:04.957942 16537 consensus_queue.cc:1048] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:05.251015 15316 consensus_queue.cc:237] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:05.252617 15465 raft_consensus.cc:1275] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:05.253747 16641 consensus_queue.cc:1048] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:05.257261 15469 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:05.258999 16640 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:05.268663 15389 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:05.271170 16478 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:59:05.272604 15284 consensus_peers.cc:597] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e55acce968e24f25b46b388a4fc2c773. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:05.274569 16640 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:05.277040 15389 raft_consensus.cc:1275] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:05.283213 15465 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:05.293278 16426 consensus_queue.cc:1048] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:05.294245 15388 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:05.295370 15466 consensus_queue.cc:237] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:05.306475 15218 catalog_manager.cc:5654] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260201 08:59:05.309672 15433 consensus_peers.cc:597] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 601eb231d2e943dcb0d893b620bbf937. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:05.311565 15391 raft_consensus.cc:1275] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:05.312330 15317 raft_consensus.cc:1275] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:05.313359 16643 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:05.314234 16601 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:05.324308 16643 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:05.326218 15391 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:59:05.343271 15266 auto_rebalancer.cc:256] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260201 08:59:05.352026 15213 catalog_manager.cc:5654] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:05.361187 15312 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:59:05.362385 15266 auto_rebalancer.cc:726] Could not move replica: Incomplete: tablet bfdb7fc00ac24ebc843ae2a3fe089389, TS 544080112cc84e33ae3530baadd1d0dd -> TS a87a3e28e16f46a2ae235d381d0b4520 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:59:05.362768 15266 auto_rebalancer.cc:266] scheduled replica move failed to complete: Incomplete: tablet bfdb7fc00ac24ebc843ae2a3fe089389, TS 544080112cc84e33ae3530baadd1d0dd -> TS a87a3e28e16f46a2ae235d381d0b4520 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:59:05.380458 15266 auto_rebalancer.cc:726] Could not move replica: Incomplete: tablet de818d695150438d84ff5feff7a448c6, TS e3f02001764a476e95c2584a094fa7d6 -> TS a87a3e28e16f46a2ae235d381d0b4520 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:59:05.380786 15266 auto_rebalancer.cc:266] scheduled replica move failed to complete: Incomplete: tablet de818d695150438d84ff5feff7a448c6, TS e3f02001764a476e95c2584a094fa7d6 -> TS a87a3e28e16f46a2ae235d381d0b4520 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:05.395642 15391 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:05.396842 16478 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:05.399030 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:05.406204 15469 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:05.407603 16640 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:05.423411 15317 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:05.424602 16635 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:05.432008 15469 raft_consensus.cc:1275] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:05.434254 16541 consensus_queue.cc:1048] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:05.450683 15467 raft_consensus.cc:1275] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:05.451973 16605 consensus_queue.cc:1048] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:05.474310 15312 raft_consensus.cc:1275] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:05.477169 16657 consensus_queue.cc:1048] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:05.496097 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:05.500237 15316 raft_consensus.cc:606] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:05.508921 15391 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "70006ed087454f3d92664b9822397752"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:05.509521 15391 raft_consensus.cc:606] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:05.516804 15391 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:05.517463 15391 raft_consensus.cc:606] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:05.522928 15313 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "de818d695150438d84ff5feff7a448c6"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:05.523525 15313 raft_consensus.cc:606] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Received request to transfer leadership to TS e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:05.524967 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260201 08:59:05.528033 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:05.528802 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:05.539410 16537 raft_consensus.cc:993] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:05.539893 16537 raft_consensus.cc:1081] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:05.542976 15317 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "70006ed087454f3d92664b9822397752"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58734
I20260201 08:59:05.543497 15317 raft_consensus.cc:493] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:05.543846 15317 raft_consensus.cc:3060] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.559824 15317 raft_consensus.cc:515] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:05.563166 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:05.563848 15391 raft_consensus.cc:3055] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:05.563720 15317 leader_election.cc:290] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119)
I20260201 08:59:05.564330 15391 raft_consensus.cc:740] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:05.564216 15976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70006ed087454f3d92664b9822397752" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
I20260201 08:59:05.565415 15976 raft_consensus.cc:3060] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.565318 15391 consensus_queue.cc:260] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:05.566461 15391 raft_consensus.cc:3060] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.571646 15976 raft_consensus.cc:2468] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:05.572795 15284 leader_election.cc:304] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:05.574216 16478 raft_consensus.cc:2804] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:05.574937 16478 raft_consensus.cc:697] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:05.575863 16478 consensus_queue.cc:237] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:05.582046 15391 raft_consensus.cc:2468] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:05.589757 16666 raft_consensus.cc:993] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:05.590231 16605 raft_consensus.cc:1081] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:05.592171 15974 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:39782
I20260201 08:59:05.592752 15974 raft_consensus.cc:493] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:05.593124 15974 raft_consensus.cc:3060] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.600762 15217 catalog_manager.cc:5654] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:05.604964 15974 raft_consensus.cc:515] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:05.606777 15974 leader_election.cc:290] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:05.608420 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:05.609081 15391 raft_consensus.cc:3055] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:05.609411 15391 raft_consensus.cc:740] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:05.610085 15391 consensus_queue.cc:260] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:05.612144 15391 raft_consensus.cc:3060] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.617022 15391 raft_consensus.cc:2468] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:05.617935 15941 leader_election.cc:304] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:05.618798 16541 raft_consensus.cc:2804] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:05.619257 16541 raft_consensus.cc:697] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:05.620210 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ad26ab3f81f457890e164908be52f74" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:05.620066 16541 consensus_queue.cc:237] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:05.620749 15313 raft_consensus.cc:3060] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.626358 15313 raft_consensus.cc:2468] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:05.630271 15217 catalog_manager.cc:5654] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:05.647065 16670 ts_tablet_manager.cc:933] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:59:05.648993 16670 tablet_copy_client.cc:323] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:59:05.650314 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet e55acce968e24f25b46b388a4fc2c773 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:59:05.650755 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet e55acce968e24f25b46b388a4fc2c773 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-e55acce968e24f25b46b388a4fc2c773
I20260201 08:59:05.658084 15330 tablet_copy_source_session.cc:215] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:05.661580 16670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55acce968e24f25b46b388a4fc2c773. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:05.673708 16670 tablet_copy_client.cc:806] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:05.674252 16670 tablet_copy_client.cc:670] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:05.677412 16670 tablet_copy_client.cc:538] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:05.685035 16670 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:05.706789 16670 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:05.707502 16670 tablet_bootstrap.cc:492] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:05.708107 16670 ts_tablet_manager.cc:1403] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.023s user 0.019s sys 0.004s
I20260201 08:59:05.710865 16670 raft_consensus.cc:359] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:05.711457 16670 raft_consensus.cc:740] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:05.712023 16670 consensus_queue.cc:260] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:05.714527 16670 ts_tablet_manager.cc:1434] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:05.720039 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-e55acce968e24f25b46b388a4fc2c773 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:59:05.720501 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-e55acce968e24f25b46b388a4fc2c773 on tablet e55acce968e24f25b46b388a4fc2c773 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:05.722654 16673 ts_tablet_manager.cc:933] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:05.724819 16673 tablet_copy_client.cc:323] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:59:05.726553 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet 601eb231d2e943dcb0d893b620bbf937 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:59:05.727046 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet 601eb231d2e943dcb0d893b620bbf937 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-601eb231d2e943dcb0d893b620bbf937
I20260201 08:59:05.734527 15479 tablet_copy_source_session.cc:215] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:05.737650 16673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 601eb231d2e943dcb0d893b620bbf937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:05.755847 16673 tablet_copy_client.cc:806] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:05.756397 16673 tablet_copy_client.cc:670] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:05.759519 16673 tablet_copy_client.cc:538] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:05.768981 16673 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:05.790482 16673 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:05.791347 16673 tablet_bootstrap.cc:492] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:05.791980 16673 ts_tablet_manager.cc:1403] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.011s
I20260201 08:59:05.794795 16673 raft_consensus.cc:359] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:05.795606 16673 raft_consensus.cc:740] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:05.796203 16673 consensus_queue.cc:260] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:05.798702 16673 ts_tablet_manager.cc:1434] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:05.801591 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-601eb231d2e943dcb0d893b620bbf937 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:59:05.802008 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-601eb231d2e943dcb0d893b620bbf937 on tablet 601eb231d2e943dcb0d893b620bbf937 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:05.817827 16478 raft_consensus.cc:993] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:05.818308 16426 raft_consensus.cc:1081] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Signalling peer e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:05.819435 15467 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "de818d695150438d84ff5feff7a448c6"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:40866
I20260201 08:59:05.819861 15467 raft_consensus.cc:493] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:05.820210 15467 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:05.825052 15467 raft_consensus.cc:515] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:05.826535 15467 leader_election.cc:290] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 3 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:05.827124 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:05.827724 15313 raft_consensus.cc:3055] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:05.828011 15313 raft_consensus.cc:740] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:05.828698 15388 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de818d695150438d84ff5feff7a448c6" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:05.829205 15388 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:05.835415 15388 raft_consensus.cc:2468] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 3.
I20260201 08:59:05.836314 15433 leader_election.cc:304] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:05.836203 15313 consensus_queue.cc:260] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:05.837013 16606 raft_consensus.cc:2804] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:05.837098 15313 raft_consensus.cc:3060] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:05.837564 16606 raft_consensus.cc:697] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:05.838384 16606 consensus_queue.cc:237] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:05.843896 15313 raft_consensus.cc:2468] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 3.
I20260201 08:59:05.847790 15217 catalog_manager.cc:5654] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 2 to 3, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 3 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:05.876572 16426 raft_consensus.cc:993] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:05.877014 16478 raft_consensus.cc:1081] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:05.878304 15469 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:40866
I20260201 08:59:05.878758 15469 raft_consensus.cc:493] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:05.879040 15469 raft_consensus.cc:3060] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.887346 15469 raft_consensus.cc:515] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:05.891647 15469 leader_election.cc:290] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:05.892040 15317 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:05.892643 15317 raft_consensus.cc:3055] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:05.892946 15317 raft_consensus.cc:740] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:05.893483 15388 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3ab6f302faf345749d3ea009054209cb" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:05.893515 15317 consensus_queue.cc:260] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:05.894163 15388 raft_consensus.cc:3060] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.895381 15317 raft_consensus.cc:3060] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:05.902045 15388 raft_consensus.cc:2468] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 2.
I20260201 08:59:05.903434 15317 raft_consensus.cc:2468] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 2.
I20260201 08:59:05.903944 15433 leader_election.cc:304] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:05.904824 16606 raft_consensus.cc:2804] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:05.905978 16606 raft_consensus.cc:697] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 2 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:05.907099 16606 consensus_queue.cc:237] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:05.919533 15217 catalog_manager.cc:5654] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 2 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:05.965452 15388 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:05.967315 16478 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:05.980715 15974 raft_consensus.cc:1275] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:05.983304 16641 consensus_queue.cc:1048] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:06.072136 15313 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:06.073382 16541 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:06.086134 15388 raft_consensus.cc:1275] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:06.087736 16541 consensus_queue.cc:1048] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:06.124629 15974 raft_consensus.cc:1217] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260201 08:59:06.182971 15974 raft_consensus.cc:1217] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:06.272706 15391 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:06.273955 16667 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:06.285401 15317 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:06.299347 16684 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:06.518433 15391 raft_consensus.cc:1275] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:06.519533 16684 consensus_queue.cc:1048] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:06.527166 15313 raft_consensus.cc:1275] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:06.637084 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260201 08:59:06.639657 15433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:45593, user_credentials={real_user=slave}} blocked reactor thread for 111476us
I20260201 08:59:06.700456 16640 raft_consensus.cc:1064] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:06.704694 16640 consensus_queue.cc:237] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:06.725755 16667 consensus_queue.cc:1048] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:06.748535 16696 raft_consensus.cc:1064] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:06.750955 16696 consensus_queue.cc:237] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:06.766355 15976 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:06.767722 16695 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:06.774578 15467 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:06.775291 15391 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:06.775955 16695 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260201 08:59:06.783004 15391 raft_consensus.cc:1275] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:06.788734 16695 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:06.790187 15320 raft_consensus.cc:1275] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:06.792390 16689 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260201 08:59:06.808202 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "43ebb725235944919ca48499c364ba78"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:06.808775 15316 raft_consensus.cc:606] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:06.809808 16640 raft_consensus.cc:993] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:06.810262 16640 raft_consensus.cc:1081] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:06.810699 15976 raft_consensus.cc:1275] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:06.812090 15388 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "43ebb725235944919ca48499c364ba78"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33104
I20260201 08:59:06.812721 15388 raft_consensus.cc:493] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:06.813102 15388 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:06.815369 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:06.815959 15469 raft_consensus.cc:606] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:06.819175 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:06.819602 15469 raft_consensus.cc:606] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:06.820770 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260201 08:59:06.822355 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:06.823071 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:06.828011 15388 raft_consensus.cc:515] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:06.845950 16640 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.848882 15976 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.871927 15217 catalog_manager.cc:5654] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.872689 15469 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.837617 16689 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:06.879979 15388 leader_election.cc:290] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 4 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:06.881687 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:06.893297 15316 raft_consensus.cc:3055] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:06.893621 15316 raft_consensus.cc:740] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:06.894280 15316 consensus_queue.cc:260] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:06.895287 15316 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:06.887825 15389 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.905827 15316 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 4.
I20260201 08:59:06.907142 15361 leader_election.cc:304] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:06.907940 16605 raft_consensus.cc:2804] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:06.908420 16605 raft_consensus.cc:697] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 4 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:06.909200 16605 consensus_queue.cc:237] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:06.909392 16689 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:06.912994 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43ebb725235944919ca48499c364ba78" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:06.913556 15467 raft_consensus.cc:3060] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:06.918488 16667 raft_consensus.cc:993] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:06.919028 16667 raft_consensus.cc:1081] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:06.919800 15467 raft_consensus.cc:2468] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 4.
I20260201 08:59:06.924045 15320 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58728
I20260201 08:59:06.924602 15320 raft_consensus.cc:493] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:06.925002 15320 raft_consensus.cc:3060] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:06.932847 15320 raft_consensus.cc:515] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:06.941140 15320 leader_election.cc:290] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Requested vote from peers e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459), a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119)
I20260201 08:59:06.941780 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:06.942473 15467 raft_consensus.cc:3055] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:06.942543 15976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3675b3fa6c6432984d1f5cfd34fd873" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
I20260201 08:59:06.943243 15976 raft_consensus.cc:3060] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:06.942902 15467 raft_consensus.cc:740] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:06.949724 15976 raft_consensus.cc:2468] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:06.953038 16689 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.953925 15389 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.953047 15284 leader_election.cc:304] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:06.957993 16695 raft_consensus.cc:2804] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:06.958437 16695 raft_consensus.cc:697] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:06.959214 16695 consensus_queue.cc:237] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:06.952564 15467 consensus_queue.cc:260] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:06.962869 15467 raft_consensus.cc:3060] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:06.973062 15467 raft_consensus.cc:2468] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 2.
I20260201 08:59:06.973644 15217 catalog_manager.cc:5654] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 3 to 4, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 4 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:06.981806 15313 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:06.980648 15320 consensus_queue.cc:237] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:06.994624 15467 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:06.995361 15974 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.001554 16695 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:07.004271 15973 raft_consensus.cc:1275] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:07.009003 15218 catalog_manager.cc:5654] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:07.010851 16698 consensus_queue.cc:1048] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:07.018267 16700 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.015530 15213 catalog_manager.cc:5654] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:07.027695 15469 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.038866 15467 consensus_queue.cc:237] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:07.041007 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet e55acce968e24f25b46b388a4fc2c773 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:07.049052 15976 raft_consensus.cc:1275] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:07.049185 15973 raft_consensus.cc:2955] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.050032 15389 raft_consensus.cc:1275] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:07.051642 16696 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:07.052595 16606 consensus_queue.cc:1048] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:07.060530 16606 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.063191 15218 catalog_manager.cc:5654] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:07.070302 15389 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.073385 15973 raft_consensus.cc:2955] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.078438 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 601eb231d2e943dcb0d893b620bbf937 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:07.078595 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet e55acce968e24f25b46b388a4fc2c773 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33090
I20260201 08:59:07.096011 15217 catalog_manager.cc:5654] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:07.103874 16718 tablet_replica.cc:333] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:07.105582 16718 raft_consensus.cc:2243] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:07.106321 16718 raft_consensus.cc:2272] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:07.111419 16718 ts_tablet_manager.cc:1916] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:07.114187 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet 601eb231d2e943dcb0d893b620bbf937 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58720
I20260201 08:59:07.116758 16719 tablet_replica.cc:333] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:07.117983 16719 raft_consensus.cc:2243] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:07.118719 16719 raft_consensus.cc:2272] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:07.121994 16719 ts_tablet_manager.cc:1916] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:07.129730 16718 ts_tablet_manager.cc:1929] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260201 08:59:07.130204 16718 log.cc:1199] T e55acce968e24f25b46b388a4fc2c773 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/e55acce968e24f25b46b388a4fc2c773
I20260201 08:59:07.131786 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet e55acce968e24f25b46b388a4fc2c773 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:07.135967 16689 raft_consensus.cc:993] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:07.137075 16689 raft_consensus.cc:1081] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:07.138477 16719 ts_tablet_manager.cc:1929] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:07.138571 15389 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33098
I20260201 08:59:07.138872 16719 log.cc:1199] T 601eb231d2e943dcb0d893b620bbf937 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/601eb231d2e943dcb0d893b620bbf937
I20260201 08:59:07.139103 15389 raft_consensus.cc:493] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:07.139398 15389 raft_consensus.cc:3060] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:07.140208 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet 601eb231d2e943dcb0d893b620bbf937 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:07.143886 15389 raft_consensus.cc:515] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:07.145375 15389 leader_election.cc:290] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459), a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119)
I20260201 08:59:07.146023 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:07.146286 15973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc5ab607d0114b979fafd03b2cd64b82" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
I20260201 08:59:07.146687 15469 raft_consensus.cc:3055] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:07.146780 15973 raft_consensus.cc:3060] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:07.147008 15469 raft_consensus.cc:740] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:07.147737 15469 consensus_queue.cc:260] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:07.148898 15469 raft_consensus.cc:3060] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:07.153422 15973 raft_consensus.cc:2468] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:07.154771 15359 leader_election.cc:304] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:07.155469 16693 raft_consensus.cc:2804] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:07.155648 15469 raft_consensus.cc:2468] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:07.155961 16693 raft_consensus.cc:697] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:07.157114 16693 consensus_queue.cc:237] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:07.166421 15217 catalog_manager.cc:5654] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:07.301447 15467 raft_consensus.cc:1275] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:59:07.302426 16605 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:07.319424 15316 raft_consensus.cc:1275] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:59:07.320780 16605 consensus_queue.cc:1048] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:07.415254 15467 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:07.416224 16698 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:07.425642 15973 raft_consensus.cc:1275] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:07.427381 16700 consensus_queue.cc:1048] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:07.560547 15469 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:07.561705 16605 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:07.574996 15973 raft_consensus.cc:1275] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:07.577602 16729 consensus_queue.cc:1048] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:07.952219 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:07.986670 15391 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:07.987263 15391 raft_consensus.cc:606] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:07.989567 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:07.990001 15316 raft_consensus.cc:606] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:07.992095 15391 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:07.992668 15391 raft_consensus.cc:606] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Received request to transfer leadership to TS e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:07.993832 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260201 08:59:07.995077 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:07.995723 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:08.024441 16701 raft_consensus.cc:993] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:08.025045 16701 raft_consensus.cc:1081] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:08.028232 15316 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58734
I20260201 08:59:08.028764 15316 raft_consensus.cc:493] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:08.029269 15316 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.034741 15316 raft_consensus.cc:515] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:08.037406 15316 leader_election.cc:290] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 3 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:08.037997 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:08.038192 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10d6363b9945401d80e4d6901e403c1b" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:08.038587 15391 raft_consensus.cc:3055] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:08.038676 15469 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.038934 15391 raft_consensus.cc:740] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:08.039624 15391 consensus_queue.cc:260] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:08.040731 15391 raft_consensus.cc:3060] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.045136 15469 raft_consensus.cc:2468] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 3.
I20260201 08:59:08.046213 15286 leader_election.cc:304] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:08.046861 16700 raft_consensus.cc:2804] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:08.047221 16700 raft_consensus.cc:697] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:08.047587 15391 raft_consensus.cc:2468] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 3.
I20260201 08:59:08.047865 16700 consensus_queue.cc:237] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:08.053218 16605 raft_consensus.cc:993] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:08.053620 16729 raft_consensus.cc:1081] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Signalling peer e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:08.054950 15469 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:40856
I20260201 08:59:08.055436 15469 raft_consensus.cc:493] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:08.055763 15469 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.057801 15213 catalog_manager.cc:5654] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 2 to 3, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 3 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:08.061820 15469 raft_consensus.cc:515] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:08.063498 15469 leader_election.cc:290] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 3 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:08.064203 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:08.064782 15316 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.065047 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:08.065594 15391 raft_consensus.cc:3055] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:08.065896 15391 raft_consensus.cc:740] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:08.066558 15391 consensus_queue.cc:260] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:08.067669 15391 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.070986 15316 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 3.
I20260201 08:59:08.072151 15435 leader_election.cc:304] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:08.072820 16691 raft_consensus.cc:2804] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:08.073292 16691 raft_consensus.cc:697] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:08.073688 15391 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 3.
I20260201 08:59:08.074095 16691 consensus_queue.cc:237] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:08.085554 15213 catalog_manager.cc:5654] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 2 to 3, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 3 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:08.106747 16731 raft_consensus.cc:993] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:08.107173 16700 raft_consensus.cc:1081] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:08.108562 15976 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53080
I20260201 08:59:08.109035 15976 raft_consensus.cc:493] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:08.109366 15976 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.114828 15976 raft_consensus.cc:515] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:08.116217 15976 leader_election.cc:290] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:08.117010 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:08.117583 15316 raft_consensus.cc:3055] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:08.117880 15316 raft_consensus.cc:740] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:08.118606 15316 consensus_queue.cc:260] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:08.119464 15316 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.120788 15391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3165dd57af4a455d83facbd02fcb4b80" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:08.121351 15391 raft_consensus.cc:3060] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:08.125439 15316 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 3.
I20260201 08:59:08.126417 15943 leader_election.cc:304] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:08.127106 16682 raft_consensus.cc:2804] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:08.127584 16682 raft_consensus.cc:697] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:08.128758 15391 raft_consensus.cc:2468] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 3.
I20260201 08:59:08.128360 16682 consensus_queue.cc:237] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:08.140792 15213 catalog_manager.cc:5654] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 2 to 3, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 3 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:08.170450 15316 consensus_queue.cc:237] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:08.176048 15469 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260201 08:59:08.176456 15284 consensus_peers.cc:597] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4526578d0507494e9dd2e42783b20ab7. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:08.176268 15391 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:08.177999 16698 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:08.178797 16731 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:08.187862 16698 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.189488 15469 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.192531 15391 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.212812 15391 consensus_queue.cc:237] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:08.217645 15213 catalog_manager.cc:5654] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.227264 15469 raft_consensus.cc:1275] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:59:08.227494 15359 consensus_peers.cc:597] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a39e92ebc0d4bc89814ec24579af33c. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:08.230329 16701 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:08.231061 15316 raft_consensus.cc:1275] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:08.233126 16701 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:08.245014 16729 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.246670 15320 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.263638 15217 catalog_manager.cc:5654] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:08.267897 15467 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.279450 15466 consensus_queue.cc:237] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:59:08.297624 15433 consensus_peers.cc:597] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de818d695150438d84ff5feff7a448c6. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:08.300905 15391 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260201 08:59:08.301792 15320 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260201 08:59:08.302060 16689 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:08.303020 16691 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:08.310417 16689 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.311988 15391 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:08.317401 15320 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:59:08.322589 15266 auto_rebalancer.cc:256] failed to send replica move request: Illegal state: Leader has not yet committed an operation in its own term
I20260201 08:59:08.333997 15213 catalog_manager.cc:5654] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 4, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 3 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
W20260201 08:59:08.344161 15266 auto_rebalancer.cc:726] Could not move replica: Incomplete: tablet bb8029b5e36242caa04004ece3d1bb98, TS 544080112cc84e33ae3530baadd1d0dd -> TS a87a3e28e16f46a2ae235d381d0b4520 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
W20260201 08:59:08.344498 15266 auto_rebalancer.cc:266] scheduled replica move failed to complete: Incomplete: tablet bb8029b5e36242caa04004ece3d1bb98, TS 544080112cc84e33ae3530baadd1d0dd -> TS a87a3e28e16f46a2ae235d381d0b4520 move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:08.477986 15391 raft_consensus.cc:1275] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:08.479800 16698 consensus_queue.cc:1048] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:08.511427 15466 raft_consensus.cc:1275] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:08.512980 16698 consensus_queue.cc:1048] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:08.570937 15389 raft_consensus.cc:1275] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:08.572314 16689 consensus_queue.cc:1048] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:08.585108 15320 raft_consensus.cc:1275] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:08.586509 16747 consensus_queue.cc:1048] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:08.668706 16755 ts_tablet_manager.cc:933] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:59:08.670869 16755 tablet_copy_client.cc:323] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:59:08.672904 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 4526578d0507494e9dd2e42783b20ab7 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:59:08.673454 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 4526578d0507494e9dd2e42783b20ab7 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-4526578d0507494e9dd2e42783b20ab7
I20260201 08:59:08.680576 15330 tablet_copy_source_session.cc:215] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:08.682127 15391 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260201 08:59:08.683284 16682 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 08:59:08.683709 16755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4526578d0507494e9dd2e42783b20ab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:08.703387 16755 tablet_copy_client.cc:806] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:08.704097 16755 tablet_copy_client.cc:670] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:08.720345 16755 tablet_copy_client.cc:538] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:08.721643 15320 raft_consensus.cc:1275] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260201 08:59:08.725514 16699 consensus_queue.cc:1048] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 08:59:08.726788 16760 ts_tablet_manager.cc:933] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:08.728804 16760 tablet_copy_client.cc:323] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:59:08.730500 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet de818d695150438d84ff5feff7a448c6 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:59:08.731024 16755 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:08.731027 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet de818d695150438d84ff5feff7a448c6 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-de818d695150438d84ff5feff7a448c6
I20260201 08:59:08.741230 15479 tablet_copy_source_session.cc:215] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:08.747334 16760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de818d695150438d84ff5feff7a448c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:08.780341 16760 tablet_copy_client.cc:806] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:08.780982 16760 tablet_copy_client.cc:670] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:08.785840 16755 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:08.786717 16755 tablet_bootstrap.cc:492] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:08.787361 16755 ts_tablet_manager.cc:1403] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.057s user 0.023s sys 0.015s
I20260201 08:59:08.790058 16755 raft_consensus.cc:359] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:08.790868 16755 raft_consensus.cc:740] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:08.791472 16755 consensus_queue.cc:260] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:08.792392 16760 tablet_copy_client.cc:538] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:08.794697 16755 ts_tablet_manager.cc:1434] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.007s user 0.007s sys 0.002s
I20260201 08:59:08.800829 16760 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:08.802134 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-4526578d0507494e9dd2e42783b20ab7 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:59:08.802582 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-4526578d0507494e9dd2e42783b20ab7 on tablet 4526578d0507494e9dd2e42783b20ab7 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:08.810987 16764 ts_tablet_manager.cc:933] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:08.822497 16764 tablet_copy_client.cc:323] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:59:08.823868 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet 9a39e92ebc0d4bc89814ec24579af33c from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:59:08.824397 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet 9a39e92ebc0d4bc89814ec24579af33c from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-9a39e92ebc0d4bc89814ec24579af33c
I20260201 08:59:08.833770 16760 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:08.834750 16760 tablet_bootstrap.cc:492] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:08.835405 16760 ts_tablet_manager.cc:1403] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.035s user 0.021s sys 0.007s
I20260201 08:59:08.838124 16760 raft_consensus.cc:359] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:08.838949 16760 raft_consensus.cc:740] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:08.839546 16760 consensus_queue.cc:260] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:08.841238 15404 tablet_copy_source_session.cc:215] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:08.842206 16760 ts_tablet_manager.cc:1434] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:08.844372 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-de818d695150438d84ff5feff7a448c6 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:59:08.844816 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-de818d695150438d84ff5feff7a448c6 on tablet de818d695150438d84ff5feff7a448c6 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:08.845352 16764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a39e92ebc0d4bc89814ec24579af33c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:08.860391 16764 tablet_copy_client.cc:806] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:08.860822 16764 tablet_copy_client.cc:670] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:08.917482 16764 tablet_copy_client.cc:538] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:08.959828 16764 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:09.006819 16764 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:09.008160 16764 tablet_bootstrap.cc:492] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:09.008893 16764 ts_tablet_manager.cc:1403] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.049s user 0.035s sys 0.009s
I20260201 08:59:09.015106 16764 raft_consensus.cc:359] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:09.016386 16764 raft_consensus.cc:740] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:09.017028 16764 consensus_queue.cc:260] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:09.021008 16764 ts_tablet_manager.cc:1434] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260201 08:59:09.022727 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-9a39e92ebc0d4bc89814ec24579af33c received from {username='slave'} at 127.0.0.1:36982
I20260201 08:59:09.023284 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-9a39e92ebc0d4bc89814ec24579af33c on tablet 9a39e92ebc0d4bc89814ec24579af33c with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:09.033178 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:09.105095 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:09.105691 15316 raft_consensus.cc:606] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:09.108335 15467 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:09.108963 15467 raft_consensus.cc:606] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Received request to transfer leadership to TS 30f18d77acb94b73a5ef2abf32e480d3
I20260201 08:59:09.111143 15973 raft_consensus.cc:1217] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20260201 08:59:09.111212 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260201 08:59:09.113088 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:09.114089 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:09.128012 16700 raft_consensus.cc:993] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:09.128525 16700 raft_consensus.cc:1081] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:09.132498 15388 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33104
I20260201 08:59:09.133113 15388 raft_consensus.cc:493] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:09.133497 15388 raft_consensus.cc:3060] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:09.145977 15388 raft_consensus.cc:515] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.149173 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:09.149845 15313 raft_consensus.cc:3055] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:09.150152 15313 raft_consensus.cc:740] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:09.150847 15973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9202773444f2496c9bbc700a0b3a85f6" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
I20260201 08:59:09.151398 15973 raft_consensus.cc:3060] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:09.152609 15313 consensus_queue.cc:260] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.153935 15313 raft_consensus.cc:3060] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:09.168097 15974 raft_consensus.cc:1217] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260201 08:59:09.157261 15388 leader_election.cc:290] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119)
I20260201 08:59:09.178987 16689 raft_consensus.cc:993] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:09.179463 16689 raft_consensus.cc:1081] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Signalling peer 30f18d77acb94b73a5ef2abf32e480d3 to start an election
I20260201 08:59:09.183398 15973 raft_consensus.cc:2468] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:09.184851 15359 leader_election.cc:304] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:09.185838 16605 raft_consensus.cc:2804] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:09.186306 16605 raft_consensus.cc:697] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:09.187091 16605 consensus_queue.cc:237] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.187852 15313 raft_consensus.cc:2468] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:09.193090 15313 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
from {username='slave'} at 127.0.0.1:58728
I20260201 08:59:09.196274 15313 raft_consensus.cc:493] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:09.196636 15313 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:09.201761 15313 raft_consensus.cc:515] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:09.203599 15313 leader_election.cc:290] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 4 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:09.204916 15467 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:09.205541 15467 raft_consensus.cc:3055] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:09.205883 15467 raft_consensus.cc:740] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:09.206832 15467 consensus_queue.cc:260] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:09.208345 15467 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:09.215508 15467 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 4.
I20260201 08:59:09.224829 15286 leader_election.cc:304] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:09.226006 16768 raft_consensus.cc:2804] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:09.226533 16768 raft_consensus.cc:697] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 LEADER]: Becoming Leader. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:09.227401 16768 consensus_queue.cc:237] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:09.228417 15388 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb8029b5e36242caa04004ece3d1bb98" candidate_uuid: "30f18d77acb94b73a5ef2abf32e480d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:09.229099 15388 raft_consensus.cc:3060] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:09.230405 15213 catalog_manager.cc:5654] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:09.237057 15388 raft_consensus.cc:2468] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30f18d77acb94b73a5ef2abf32e480d3 in term 4.
I20260201 08:59:09.245646 15217 catalog_manager.cc:5654] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: term changed from 3 to 4, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65). New cstate: current_term: 4 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:09.363325 15973 raft_consensus.cc:1217] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:09.575627 16747 raft_consensus.cc:1064] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:09.578033 16747 consensus_queue.cc:237] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.583885 15973 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 LEARNER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260201 08:59:09.584002 15316 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260201 08:59:09.585947 16689 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:09.589069 16747 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:09.590209 15389 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260201 08:59:09.592782 16747 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:09.601610 16691 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.605422 15316 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.609524 16700 raft_consensus.cc:1064] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:09.621855 15973 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.623559 15213 catalog_manager.cc:5654] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index 4 to 5, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:09.624828 16700 consensus_queue.cc:237] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.621869 15389 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.643193 15974 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:09.645205 15388 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:09.645218 16768 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260201 08:59:09.647892 16731 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:09.655006 15466 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:09.658079 16700 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:09.668365 15312 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:09.676581 16605 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:09.683157 15469 raft_consensus.cc:1275] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:59:09.678560 15466 consensus_queue.cc:237] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.687016 16698 consensus_queue.cc:1048] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:09.690490 15389 raft_consensus.cc:1275] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 4 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:59:09.692718 15388 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260201 08:59:09.693543 15973 raft_consensus.cc:1275] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260201 08:59:09.692296 16700 consensus_queue.cc:1048] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:09.699108 16747 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 08:59:09.701653 16691 consensus_queue.cc:1048] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 08:59:09.711495 16698 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.713284 16689 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.719601 15389 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.730523 15388 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.732910 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet de818d695150438d84ff5feff7a448c6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:09.723668 15973 raft_consensus.cc:1275] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:09.723659 15466 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.728708 15974 raft_consensus.cc:2955] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.744401 16701 consensus_queue.cc:1048] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:09.771849 15974 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.781077 15218 catalog_manager.cc:5654] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 5 to 6, VOTER 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) evicted. New cstate: current_term: 3 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.794090 15213 catalog_manager.cc:5654] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:09.811933 15306 tablet_service.cc:1552] Processing DeleteTablet for tablet de818d695150438d84ff5feff7a448c6 with delete_type TABLET_DATA_TOMBSTONED (TS 30f18d77acb94b73a5ef2abf32e480d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58720
I20260201 08:59:09.813951 16792 tablet_replica.cc:333] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:09.816305 16792 raft_consensus.cc:2243] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:09.818455 16792 raft_consensus.cc:2272] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:09.830380 15312 consensus_queue.cc:237] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.835126 16792 ts_tablet_manager.cc:1916] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:09.837561 15973 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:09.837610 15466 raft_consensus.cc:1275] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:09.839226 16700 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:09.846079 16700 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.849056 16731 consensus_queue.cc:1048] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:09.855136 15974 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.852500 15466 raft_consensus.cc:2955] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.866520 16792 ts_tablet_manager.cc:1929] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260201 08:59:09.866971 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4526578d0507494e9dd2e42783b20ab7 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:09.867116 16792 log.cc:1199] T de818d695150438d84ff5feff7a448c6 P 30f18d77acb94b73a5ef2abf32e480d3: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/wals/de818d695150438d84ff5feff7a448c6
I20260201 08:59:09.873567 15205 catalog_manager.cc:4985] TS 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): tablet de818d695150438d84ff5feff7a448c6 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:09.873796 15218 catalog_manager.cc:5654] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:09.898409 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 4526578d0507494e9dd2e42783b20ab7 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33090
I20260201 08:59:09.921818 16793 tablet_replica.cc:333] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:09.922741 16793 raft_consensus.cc:2243] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:09.923414 16793 raft_consensus.cc:2272] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:09.927130 16793 ts_tablet_manager.cc:1916] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:09.935329 16605 raft_consensus.cc:1064] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:09.937758 16605 consensus_queue.cc:237] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:09.944392 15974 raft_consensus.cc:1275] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:09.944967 15466 raft_consensus.cc:1275] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:09.947072 15312 raft_consensus.cc:1275] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:09.948154 16793 ts_tablet_manager.cc:1929] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260201 08:59:09.947937 16605 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:09.948697 16793 log.cc:1199] T 4526578d0507494e9dd2e42783b20ab7 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/4526578d0507494e9dd2e42783b20ab7
I20260201 08:59:09.948998 16701 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:09.949788 16771 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:09.951084 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 4526578d0507494e9dd2e42783b20ab7 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:09.964108 16771 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.965952 15974 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.967679 15316 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.982299 15466 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:09.992475 15217 catalog_manager.cc:5654] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:10.006703 15389 consensus_queue.cc:237] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:10.011266 15316 raft_consensus.cc:1275] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:10.011479 15973 raft_consensus.cc:1275] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:10.013154 16771 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260201 08:59:10.016355 16605 consensus_queue.cc:1048] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:10.021517 16771 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:10.023005 15316 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:10.024682 15973 raft_consensus.cc:2955] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:10.031430 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9a39e92ebc0d4bc89814ec24579af33c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:10.040017 15216 catalog_manager.cc:5654] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:10.051811 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet 9a39e92ebc0d4bc89814ec24579af33c with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40852
I20260201 08:59:10.053706 16798 tablet_replica.cc:333] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:10.054630 16798 raft_consensus.cc:2243] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:10.055228 16798 raft_consensus.cc:2272] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:10.057868 16798 ts_tablet_manager.cc:1916] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:10.072507 16798 ts_tablet_manager.cc:1929] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:10.072985 16798 log.cc:1199] T 9a39e92ebc0d4bc89814ec24579af33c P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/9a39e92ebc0d4bc89814ec24579af33c
I20260201 08:59:10.075575 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet 9a39e92ebc0d4bc89814ec24579af33c (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:10.168668 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:10.207926 15316 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641"
dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:51668
I20260201 08:59:10.208410 15316 raft_consensus.cc:606] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:10.211230 15394 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:10.211869 15394 raft_consensus.cc:606] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:10.213822 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260201 08:59:10.215757 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:10.216442 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:10.561919 16771 raft_consensus.cc:993] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:10.562342 16605 raft_consensus.cc:1081] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:10.563604 15466 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:40856
I20260201 08:59:10.564090 15466 raft_consensus.cc:493] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:10.564360 15466 raft_consensus.cc:3060] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:10.569057 15466 raft_consensus.cc:515] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:10.570492 15466 leader_election.cc:290] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119)
I20260201 08:59:10.571267 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:10.571341 15973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15ac6b4592d14c9085fa39e7b3613e9b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
I20260201 08:59:10.571764 15394 raft_consensus.cc:3055] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:10.571913 15973 raft_consensus.cc:3060] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:10.572130 15394 raft_consensus.cc:740] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:10.573155 15394 consensus_queue.cc:260] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:10.574273 15394 raft_consensus.cc:3060] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:10.579491 15973 raft_consensus.cc:2468] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 2.
I20260201 08:59:10.580564 15433 leader_election.cc:304] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:10.580827 15394 raft_consensus.cc:2468] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 2.
I20260201 08:59:10.581172 16689 raft_consensus.cc:2804] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:10.581575 16689 raft_consensus.cc:697] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 2 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:10.582454 16689 consensus_queue.cc:237] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:10.593567 15218 catalog_manager.cc:5654] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 2 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:10.678062 16731 raft_consensus.cc:993] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:10.678489 16700 raft_consensus.cc:1081] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:10.679925 15973 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53080
I20260201 08:59:10.680404 15973 raft_consensus.cc:493] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:10.680680 15973 raft_consensus.cc:3060] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:10.685277 15973 raft_consensus.cc:515] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:10.687455 15973 leader_election.cc:290] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:10.688110 15389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:10.688716 15389 raft_consensus.cc:3060] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:10.689646 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e64d88347b44f8e8c8f0aa30d129641" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:10.690186 15316 raft_consensus.cc:3055] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:10.690475 15316 raft_consensus.cc:740] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30f18d77acb94b73a5ef2abf32e480d3, State: Running, Role: LEADER
I20260201 08:59:10.691279 15316 consensus_queue.cc:260] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:10.692531 15316 raft_consensus.cc:3060] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:10.695379 15389 raft_consensus.cc:2468] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:10.696666 15941 leader_election.cc:304] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 544080112cc84e33ae3530baadd1d0dd, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:10.697746 16759 raft_consensus.cc:2804] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:10.698387 16759 raft_consensus.cc:697] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:10.699064 15316 raft_consensus.cc:2468] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:10.699239 16759 consensus_queue.cc:237] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:10.715350 15218 catalog_manager.cc:5654] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:11.056790 15389 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:11.058178 16805 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:11.079802 15973 raft_consensus.cc:1275] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:11.086088 16805 consensus_queue.cc:1048] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:11.120615 15312 consensus_queue.cc:237] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.127241 15466 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260201 08:59:11.127776 15284 consensus_peers.cc:597] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aff4e6978c594672a5ad5e2b9fe02d80. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:11.128955 16768 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:11.130503 15394 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:11.131937 16731 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:11.142647 16700 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.144344 15466 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.144322 15394 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.159231 15218 catalog_manager.cc:5654] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.169255 15312 consensus_queue.cc:237] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.176177 15466 raft_consensus.cc:1275] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:59:11.177059 15284 consensus_peers.cc:597] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86eab638067c49e79e1bdd4a3902cf7b. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:11.177737 15394 raft_consensus.cc:1275] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:11.177531 16731 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:11.179073 16700 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:11.183692 15389 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:11.185631 16799 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:11.195968 16700 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.199985 15469 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.201469 15312 raft_consensus.cc:1275] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:11.207626 16799 consensus_queue.cc:1048] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:11.210803 15394 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.221769 15218 catalog_manager.cc:5654] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.235565 15312 consensus_queue.cc:237] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.248474 15466 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:11.250157 16820 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260201 08:59:11.251014 15284 consensus_peers.cc:597] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfdb7fc00ac24ebc843ae2a3fe089389. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:11.249977 15394 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:11.251814 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:11.252552 16768 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:11.259763 16768 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.269416 15466 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.271060 15394 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.279000 15389 consensus_queue.cc:237] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.280079 15218 catalog_manager.cc:5654] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:11.307080 15466 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:11.309005 15312 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260201 08:59:11.308954 15466 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:11.310158 15466 raft_consensus.cc:606] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:11.309891 16825 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:11.311143 16605 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:11.311810 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260201 08:59:11.313578 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:11.314296 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260201 08:59:11.312624 15359 consensus_peers.cc:597] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5ecb583266e43b38c0deee2e253c52f. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:11.333751 16605 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.339043 15316 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.350313 15466 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.361981 15216 catalog_manager.cc:5654] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index -1 to 3, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:11.503475 16805 raft_consensus.cc:993] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:11.503916 16747 raft_consensus.cc:1081] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer 544080112cc84e33ae3530baadd1d0dd to start an election
I20260201 08:59:11.505373 15389 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
from {username='slave'} at 127.0.0.1:33098
I20260201 08:59:11.505892 15389 raft_consensus.cc:493] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:11.506232 15389 raft_consensus.cc:3060] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:11.513105 15389 raft_consensus.cc:515] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:11.514364 15389 leader_election.cc:290] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:11.514992 15313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:11.515205 15466 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "770d2fda022243328e17c46e34e5f4b5" candidate_uuid: "544080112cc84e33ae3530baadd1d0dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:11.515522 15313 raft_consensus.cc:3060] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:11.515933 15466 raft_consensus.cc:3055] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:11.516199 15466 raft_consensus.cc:740] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:11.516693 15466 consensus_queue.cc:260] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:11.517544 15466 raft_consensus.cc:3060] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:11.521548 15313 raft_consensus.cc:2468] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:11.522609 15466 raft_consensus.cc:2468] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 544080112cc84e33ae3530baadd1d0dd in term 2.
I20260201 08:59:11.522744 15361 leader_election.cc:304] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd; no voters:
I20260201 08:59:11.523464 16825 raft_consensus.cc:2804] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:11.523914 16825 raft_consensus.cc:697] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Becoming Leader. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:11.524653 16825 consensus_queue.cc:237] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } }
I20260201 08:59:11.536970 15218 catalog_manager.cc:5654] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to 544080112cc84e33ae3530baadd1d0dd (127.13.194.66). New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:11.658325 16829 ts_tablet_manager.cc:933] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:59:11.661162 16829 tablet_copy_client.cc:323] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:59:11.662859 15330 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet aff4e6978c594672a5ad5e2b9fe02d80 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:59:11.663300 15330 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet aff4e6978c594672a5ad5e2b9fe02d80 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-aff4e6978c594672a5ad5e2b9fe02d80
I20260201 08:59:11.670037 15330 tablet_copy_source_session.cc:215] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:11.674201 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff4e6978c594672a5ad5e2b9fe02d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:11.687556 16829 tablet_copy_client.cc:806] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:11.688164 16829 tablet_copy_client.cc:670] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:11.692916 16829 tablet_copy_client.cc:538] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:11.706359 16829 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:11.726055 16829 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:11.726912 16829 tablet_bootstrap.cc:492] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:11.727532 16829 ts_tablet_manager.cc:1403] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.021s user 0.013s sys 0.007s
I20260201 08:59:11.730322 16829 raft_consensus.cc:359] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.731016 16829 raft_consensus.cc:740] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:11.731775 16829 consensus_queue.cc:260] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.733963 16829 ts_tablet_manager.cc:1434] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260201 08:59:11.737617 16832 ts_tablet_manager.cc:933] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:59:11.739275 16832 tablet_copy_client.cc:323] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:59:11.743947 15329 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet 86eab638067c49e79e1bdd4a3902cf7b from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:59:11.744398 15329 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet 86eab638067c49e79e1bdd4a3902cf7b from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-86eab638067c49e79e1bdd4a3902cf7b
I20260201 08:59:11.745076 15330 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-aff4e6978c594672a5ad5e2b9fe02d80 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:59:11.745424 15330 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-aff4e6978c594672a5ad5e2b9fe02d80 on tablet aff4e6978c594672a5ad5e2b9fe02d80 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:11.752573 15329 tablet_copy_source_session.cc:215] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:11.755590 16832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86eab638067c49e79e1bdd4a3902cf7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:11.813472 16832 tablet_copy_client.cc:806] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:11.814029 16832 tablet_copy_client.cc:670] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:11.820216 16829 ts_tablet_manager.cc:933] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253)
I20260201 08:59:11.835840 16832 tablet_copy_client.cc:538] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:11.850142 16832 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:11.856982 16829 tablet_copy_client.cc:323] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.65:41253
I20260201 08:59:11.858696 15329 tablet_copy_service.cc:140] P 30f18d77acb94b73a5ef2abf32e480d3: Received BeginTabletCopySession request for tablet bfdb7fc00ac24ebc843ae2a3fe089389 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:58740)
I20260201 08:59:11.859301 15329 tablet_copy_service.cc:161] P 30f18d77acb94b73a5ef2abf32e480d3: Beginning new tablet copy session on tablet bfdb7fc00ac24ebc843ae2a3fe089389 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:58740: session id = a87a3e28e16f46a2ae235d381d0b4520-bfdb7fc00ac24ebc843ae2a3fe089389
I20260201 08:59:11.866873 15329 tablet_copy_source_session.cc:215] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:11.871335 16829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdb7fc00ac24ebc843ae2a3fe089389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:11.886965 16829 tablet_copy_client.cc:806] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:11.887521 16829 tablet_copy_client.cc:670] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:11.892148 16836 ts_tablet_manager.cc:933] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:11.897672 16836 tablet_copy_client.cc:323] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:59:11.899102 15404 tablet_copy_service.cc:140] P 544080112cc84e33ae3530baadd1d0dd: Received BeginTabletCopySession request for tablet f5ecb583266e43b38c0deee2e253c52f from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:36982)
I20260201 08:59:11.899632 15404 tablet_copy_service.cc:161] P 544080112cc84e33ae3530baadd1d0dd: Beginning new tablet copy session on tablet f5ecb583266e43b38c0deee2e253c52f from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:36982: session id = a87a3e28e16f46a2ae235d381d0b4520-f5ecb583266e43b38c0deee2e253c52f
I20260201 08:59:11.900409 16832 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:11.901366 16832 tablet_bootstrap.cc:492] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:11.902055 16832 ts_tablet_manager.cc:1403] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.052s user 0.014s sys 0.009s
I20260201 08:59:11.907866 16832 raft_consensus.cc:359] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.908568 16832 raft_consensus.cc:740] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:11.909242 16832 consensus_queue.cc:260] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:11.914549 15312 raft_consensus.cc:1275] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:11.914906 16832 ts_tablet_manager.cc:1434] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.013s user 0.002s sys 0.004s
I20260201 08:59:11.915746 16829 tablet_copy_client.cc:538] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:11.920576 16771 consensus_queue.cc:1048] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:11.921573 15404 tablet_copy_source_session.cc:215] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:11.923486 15329 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-86eab638067c49e79e1bdd4a3902cf7b received from {username='slave'} at 127.0.0.1:58740
I20260201 08:59:11.923952 15329 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-86eab638067c49e79e1bdd4a3902cf7b on tablet 86eab638067c49e79e1bdd4a3902cf7b with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:11.931627 16829 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:11.937570 16836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ecb583266e43b38c0deee2e253c52f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:11.962806 15469 raft_consensus.cc:1275] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:11.965408 16605 consensus_queue.cc:1048] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:12.000039 16829 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:12.000978 16829 tablet_bootstrap.cc:492] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:12.001648 16829 ts_tablet_manager.cc:1403] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.070s user 0.038s sys 0.007s
I20260201 08:59:12.004833 16829 raft_consensus.cc:359] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:12.005682 16829 raft_consensus.cc:740] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:12.006335 16829 consensus_queue.cc:260] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:12.009447 16829 ts_tablet_manager.cc:1434] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260201 08:59:12.023017 16836 tablet_copy_client.cc:806] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:12.023623 16836 tablet_copy_client.cc:670] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
I20260201 08:59:12.028362 15329 tablet_copy_service.cc:342] P 30f18d77acb94b73a5ef2abf32e480d3: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-bfdb7fc00ac24ebc843ae2a3fe089389 received from {username='slave'} at 127.0.0.1:58740
I20260201 08:59:12.028828 15329 tablet_copy_service.cc:434] P 30f18d77acb94b73a5ef2abf32e480d3: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-bfdb7fc00ac24ebc843ae2a3fe089389 on tablet bfdb7fc00ac24ebc843ae2a3fe089389 with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:12.030537 16836 tablet_copy_client.cc:538] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260201 08:59:12.040302 16836 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:12.062394 16836 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:12.063117 16836 tablet_bootstrap.cc:492] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:12.063679 16836 ts_tablet_manager.cc:1403] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.004s
I20260201 08:59:12.065989 16836 raft_consensus.cc:359] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:12.066684 16836 raft_consensus.cc:740] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:12.067265 16836 consensus_queue.cc:260] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:12.069954 16836 ts_tablet_manager.cc:1434] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:12.072678 15404 tablet_copy_service.cc:342] P 544080112cc84e33ae3530baadd1d0dd: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-f5ecb583266e43b38c0deee2e253c52f received from {username='slave'} at 127.0.0.1:36982
I20260201 08:59:12.073098 15404 tablet_copy_service.cc:434] P 544080112cc84e33ae3530baadd1d0dd: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-f5ecb583266e43b38c0deee2e253c52f on tablet f5ecb583266e43b38c0deee2e253c52f with peer a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:12.240507 15976 raft_consensus.cc:1217] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:12.249768 15976 raft_consensus.cc:1217] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260201 08:59:12.283931 15976 raft_consensus.cc:1217] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260201 08:59:12.328586 15976 raft_consensus.cc:1217] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260201 08:59:12.369112 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:12.415877 15394 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b"
dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
mode: GRACEFUL
new_leader_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:57234
I20260201 08:59:12.416348 15394 raft_consensus.cc:606] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Received request to transfer leadership to TS e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:12.417408 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260201 08:59:12.418577 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:12.419100 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:12.546868 16825 raft_consensus.cc:993] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: : Instructing follower e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:12.547260 16605 raft_consensus.cc:1081] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Signalling peer e3f02001764a476e95c2584a094fa7d6 to start an election
I20260201 08:59:12.548516 15469 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
from {username='slave'} at 127.0.0.1:40856
I20260201 08:59:12.549036 15469 raft_consensus.cc:493] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:12.549346 15469 raft_consensus.cc:3060] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:12.554261 15469 raft_consensus.cc:515] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.556162 15469 leader_election.cc:290] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 2 election: Requested vote from peers 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593), a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119)
I20260201 08:59:12.557271 15976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
I20260201 08:59:12.557845 15976 raft_consensus.cc:3060] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:12.557916 15394 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8085f989cb7c433b9306a89ddf9cf36b" candidate_uuid: "e3f02001764a476e95c2584a094fa7d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "544080112cc84e33ae3530baadd1d0dd"
I20260201 08:59:12.558454 15394 raft_consensus.cc:3055] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:12.558764 15394 raft_consensus.cc:740] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 544080112cc84e33ae3530baadd1d0dd, State: Running, Role: LEADER
I20260201 08:59:12.559569 15394 consensus_queue.cc:260] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.560679 15394 raft_consensus.cc:3060] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:12.564250 15976 raft_consensus.cc:2468] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 2.
I20260201 08:59:12.565393 15433 leader_election.cc:304] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520, e3f02001764a476e95c2584a094fa7d6; no voters:
I20260201 08:59:12.566463 16805 raft_consensus.cc:2804] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:12.566911 16805 raft_consensus.cc:697] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 2 LEADER]: Becoming Leader. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:12.566967 15394 raft_consensus.cc:2468] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f02001764a476e95c2584a094fa7d6 in term 2.
I20260201 08:59:12.567799 16805 consensus_queue.cc:237] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.577802 15216 catalog_manager.cc:5654] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 reported cstate change: term changed from 1 to 2, leader changed from 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) to e3f02001764a476e95c2584a094fa7d6 (127.13.194.67). New cstate: current_term: 2 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:12.701431 16700 raft_consensus.cc:1064] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:12.703280 16700 consensus_queue.cc:237] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.708631 15974 raft_consensus.cc:1275] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:12.709185 16825 raft_consensus.cc:1064] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:12.710444 16820 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:12.711288 15466 raft_consensus.cc:1275] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:12.712576 16820 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:12.712888 15394 raft_consensus.cc:1275] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 08:59:12.711457 16825 consensus_queue.cc:237] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.714479 16820 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:12.731225 16768 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.732583 15316 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:12.735083 16605 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:12.732543 15469 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:12.738801 16605 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:12.738293 15394 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.742574 15469 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.749254 15974 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:12.757555 16825 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:12.760783 15974 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.771360 15216 catalog_manager.cc:5654] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 2 to 3, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.807410 15320 consensus_queue.cc:237] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.823256 15466 raft_consensus.cc:1275] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:12.837968 16820 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260201 08:59:12.840483 16825 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.852275 15973 raft_consensus.cc:1275] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260201 08:59:12.843858 15976 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.866230 16700 raft_consensus.cc:1064] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
W20260201 08:59:12.867147 15433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:37119, user_credentials={real_user=slave}} blocked reactor thread for 52309.8us
I20260201 08:59:12.868774 16700 consensus_queue.cc:237] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.897055 16865 consensus_queue.cc:1048] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:12.907694 16865 raft_consensus.cc:1064] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: attempting to promote NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 to VOTER
I20260201 08:59:12.911686 16820 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.917867 15320 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.922545 16865 consensus_queue.cc:237] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:12.914261 15973 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
W20260201 08:59:12.942677 15433 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:37119, user_credentials={real_user=slave}} blocked reactor thread for 57431.4us
I20260201 08:59:12.958976 15218 catalog_manager.cc:5654] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.969051 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 86eab638067c49e79e1bdd4a3902cf7b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260201 08:59:12.976544 15286 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:39459, user_credentials={real_user=slave}} blocked reactor thread for 90924.9us
I20260201 08:59:12.976051 15469 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:12.996209 15466 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:12.998268 15976 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:13.001833 15466 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:13.002175 16865 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:13.004835 15391 consensus_queue.cc:237] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:13.013104 15973 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEARNER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:13.014655 16865 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:13.016498 16858 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:13.017163 15388 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:13.018780 15320 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.019652 15973 raft_consensus.cc:1275] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.020431 16858 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:13.021842 16873 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:13.011036 16820 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260201 08:59:13.031383 16874 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.034644 15975 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.045670 15977 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.052346 15216 catalog_manager.cc:5654] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 1 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.053273 15203 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f5ecb583266e43b38c0deee2e253c52f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:13.054409 16871 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:13.064917 15467 raft_consensus.cc:2955] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.072992 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet 86eab638067c49e79e1bdd4a3902cf7b with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33090
I20260201 08:59:13.069541 16872 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.079069 15976 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.087925 16873 consensus_queue.cc:1048] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:13.103056 16886 tablet_replica.cc:333] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:13.110060 15465 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.097971 15216 catalog_manager.cc:5654] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 2 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:13.118907 15388 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260201 08:59:13.119141 15312 raft_consensus.cc:2955] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.121883 16768 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:13.105959 16886 raft_consensus.cc:2243] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:13.133329 16886 raft_consensus.cc:2272] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:13.135900 16879 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.139365 15469 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.141568 15388 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.144418 16886 ts_tablet_manager.cc:1916] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:13.160583 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet f5ecb583266e43b38c0deee2e253c52f with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40852
I20260201 08:59:13.179751 15388 raft_consensus.cc:1275] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.175774 15218 catalog_manager.cc:5654] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.194595 16889 tablet_replica.cc:333] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:13.201047 16868 consensus_queue.cc:1048] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260201 08:59:13.214206 16889 raft_consensus.cc:2243] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:13.226893 15320 consensus_queue.cc:237] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:13.239773 16889 raft_consensus.cc:2272] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:13.247560 16889 ts_tablet_manager.cc:1916] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:13.240808 15217 catalog_manager.cc:5654] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:13.264958 15391 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.229432 15976 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.251965 15389 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } attrs { replace: true } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.273847 15312 consensus_queue.cc:237] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:13.278295 16700 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:13.283610 15466 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.285354 16820 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:13.286619 16886 ts_tablet_manager.cc:1929] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260201 08:59:13.287982 16886 log.cc:1199] T 86eab638067c49e79e1bdd4a3902cf7b P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/86eab638067c49e79e1bdd4a3902cf7b
I20260201 08:59:13.294014 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet 86eab638067c49e79e1bdd4a3902cf7b (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:13.295852 15977 raft_consensus.cc:1275] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.300724 16889 ts_tablet_manager.cc:1929] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260201 08:59:13.304927 16889 log.cc:1199] T f5ecb583266e43b38c0deee2e253c52f P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/f5ecb583266e43b38c0deee2e253c52f
I20260201 08:59:13.307353 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet f5ecb583266e43b38c0deee2e253c52f (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:13.308670 16700 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.312590 16768 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.318470 16877 consensus_queue.cc:1048] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 08:59:13.326413 15389 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.332710 15977 raft_consensus.cc:2955] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.323863 15469 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.352099 15973 raft_consensus.cc:1275] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Refusing update from remote peer 30f18d77acb94b73a5ef2abf32e480d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:13.362323 16820 consensus_queue.cc:1048] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:13.367508 15976 raft_consensus.cc:2955] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } } }
I20260201 08:59:13.376207 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet aff4e6978c594672a5ad5e2b9fe02d80 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:13.380721 15205 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet bfdb7fc00ac24ebc843ae2a3fe089389 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260201 08:59:13.390266 15216 catalog_manager.cc:5654] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 4 to 5, VOTER 544080112cc84e33ae3530baadd1d0dd (127.13.194.66) evicted. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:13.392097 15216 catalog_manager.cc:5654] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 reported cstate change: config changed from index 4 to 5, VOTER e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) evicted. New cstate: current_term: 2 leader_uuid: "30f18d77acb94b73a5ef2abf32e480d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:13.414175 15377 tablet_service.cc:1552] Processing DeleteTablet for tablet bfdb7fc00ac24ebc843ae2a3fe089389 with delete_type TABLET_DATA_TOMBSTONED (TS 544080112cc84e33ae3530baadd1d0dd not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33090
I20260201 08:59:13.415091 16886 tablet_replica.cc:333] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:13.415221 15450 tablet_service.cc:1552] Processing DeleteTablet for tablet aff4e6978c594672a5ad5e2b9fe02d80 with delete_type TABLET_DATA_TOMBSTONED (TS e3f02001764a476e95c2584a094fa7d6 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40852
I20260201 08:59:13.416136 16889 tablet_replica.cc:333] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:13.416729 16886 raft_consensus.cc:2243] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:13.417032 16889 raft_consensus.cc:2243] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:13.417555 16886 raft_consensus.cc:2272] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:13.417670 16889 raft_consensus.cc:2272] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:13.422924 16886 ts_tablet_manager.cc:1916] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:13.425107 16889 ts_tablet_manager.cc:1916] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260201 08:59:13.442036 16886 ts_tablet_manager.cc:1929] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260201 08:59:13.442626 16886 log.cc:1199] T bfdb7fc00ac24ebc843ae2a3fe089389 P 544080112cc84e33ae3530baadd1d0dd: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/wals/bfdb7fc00ac24ebc843ae2a3fe089389
I20260201 08:59:13.443332 16889 ts_tablet_manager.cc:1929] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260201 08:59:13.443792 16889 log.cc:1199] T aff4e6978c594672a5ad5e2b9fe02d80 P e3f02001764a476e95c2584a094fa7d6: Deleting WAL directory at /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/wals/aff4e6978c594672a5ad5e2b9fe02d80
I20260201 08:59:13.444248 15203 catalog_manager.cc:4985] TS 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): tablet bfdb7fc00ac24ebc843ae2a3fe089389 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:13.445273 15205 catalog_manager.cc:4985] TS e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): tablet aff4e6978c594672a5ad5e2b9fe02d80 (table test-workload [id=c68ca87543e24ad59eb44829721c21b6]) successfully deleted
I20260201 08:59:13.466851 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:13.500692 15469 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6"
dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
mode: GRACEFUL
new_leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:33624
I20260201 08:59:13.501184 15469 raft_consensus.cc:606] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Received request to transfer leadership to TS a87a3e28e16f46a2ae235d381d0b4520
I20260201 08:59:13.502287 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260201 08:59:13.503362 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:13.503933 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:13.998749 16869 raft_consensus.cc:993] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: : Instructing follower a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:13.999224 16871 raft_consensus.cc:1081] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Signalling peer a87a3e28e16f46a2ae235d381d0b4520 to start an election
I20260201 08:59:14.000541 15977 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6"
dest_uuid: "a87a3e28e16f46a2ae235d381d0b4520"
from {username='slave'} at 127.0.0.1:53064
I20260201 08:59:14.001039 15977 raft_consensus.cc:493] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:14.001351 15977 raft_consensus.cc:3060] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:14.005827 15977 raft_consensus.cc:515] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:14.007314 15977 leader_election.cc:290] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Requested vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:14.007999 15316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "30f18d77acb94b73a5ef2abf32e480d3"
I20260201 08:59:14.008504 15469 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d83cd76a3c124667a5c4e76abfdcb0e6" candidate_uuid: "a87a3e28e16f46a2ae235d381d0b4520" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3f02001764a476e95c2584a094fa7d6"
I20260201 08:59:14.008733 15316 raft_consensus.cc:3060] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:14.009094 15469 raft_consensus.cc:3055] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:14.009382 15469 raft_consensus.cc:740] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3f02001764a476e95c2584a094fa7d6, State: Running, Role: LEADER
I20260201 08:59:14.010032 15469 consensus_queue.cc:260] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:14.011132 15469 raft_consensus.cc:3060] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:14.015043 15316 raft_consensus.cc:2468] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:14.016393 15943 leader_election.cc:304] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30f18d77acb94b73a5ef2abf32e480d3, a87a3e28e16f46a2ae235d381d0b4520; no voters:
I20260201 08:59:14.017035 15469 raft_consensus.cc:2468] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a87a3e28e16f46a2ae235d381d0b4520 in term 2.
I20260201 08:59:14.017530 16863 raft_consensus.cc:2804] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:14.017998 16863 raft_consensus.cc:697] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Becoming Leader. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Running, Role: LEADER
I20260201 08:59:14.018772 16863 consensus_queue.cc:237] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:14.030216 15213 catalog_manager.cc:5654] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 reported cstate change: term changed from 1 to 2, leader changed from e3f02001764a476e95c2584a094fa7d6 (127.13.194.67) to a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68). New cstate: current_term: 2 leader_uuid: "a87a3e28e16f46a2ae235d381d0b4520" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260201 08:59:14.409314 15320 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:14.411442 16864 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:14.434904 15469 raft_consensus.cc:1275] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Refusing update from remote peer a87a3e28e16f46a2ae235d381d0b4520: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260201 08:59:14.436431 16901 consensus_queue.cc:1048] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 08:59:14.479827 15466 consensus_queue.cc:237] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:14.486626 15388 raft_consensus.cc:1275] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260201 08:59:14.487154 15433 consensus_peers.cc:597] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3cde26b6b4d4157a86e3c2b67ca2d72. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.488085 15320 raft_consensus.cc:1275] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer e3f02001764a476e95c2584a094fa7d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:14.489739 16869 consensus_queue.cc:1048] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:14.492286 16871 consensus_queue.cc:1048] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:14.499107 16869 raft_consensus.cc:2955] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.500481 15388 raft_consensus.cc:2955] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.513212 15389 consensus_queue.cc:237] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:14.509078 15320 raft_consensus.cc:2955] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.517196 15213 catalog_manager.cc:5654] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "e3f02001764a476e95c2584a094fa7d6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260201 08:59:14.527652 15359 consensus_peers.cc:597] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c2f539e5f0bc47eeb6b625d9cdfc7327. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.535579 15466 raft_consensus.cc:1275] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:14.536756 16893 consensus_queue.cc:1048] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:14.537741 15320 raft_consensus.cc:1275] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:14.538906 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:14.540050 16893 consensus_queue.cc:1048] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:14.545140 16873 raft_consensus.cc:2955] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.547211 15469 raft_consensus.cc:2955] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.549409 15320 raft_consensus.cc:2955] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.566429 15389 consensus_queue.cc:237] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:59:14.584239 15359 consensus_peers.cc:597] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd -> Peer a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68:37119): Couldn't send request to peer a87a3e28e16f46a2ae235d381d0b4520. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46ee294a812241f3a8153b898b24e7c4. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.570628 15213 catalog_manager.cc:5654] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:14.590035 15320 raft_consensus.cc:1275] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:14.591128 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260201 08:59:14.591447 16914 consensus_queue.cc:1048] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:14.591784 15469 raft_consensus.cc:1275] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Refusing update from remote peer 544080112cc84e33ae3530baadd1d0dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 08:59:14.592747 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:14.593638 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:14.593922 16873 consensus_queue.cc:1048] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:14.612219 16873 raft_consensus.cc:2955] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.620913 15316 raft_consensus.cc:2955] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.623430 15466 raft_consensus.cc:2955] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } } }
I20260201 08:59:14.648751 15213 catalog_manager.cc:5654] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd reported cstate change: config changed from index -1 to 2, NON_VOTER a87a3e28e16f46a2ae235d381d0b4520 (127.13.194.68) added. New cstate: current_term: 1 leader_uuid: "544080112cc84e33ae3530baadd1d0dd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:14.658231 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:14.706076 14089 tablet_server.cc:178] TabletServer@127.13.194.65:0 shutting down...
W20260201 08:59:14.729863 15943 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260201 08:59:14.733916 15943 consensus_peers.cc:597] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.742043 15361 consensus_peers.cc:597] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.749614 15943 consensus_peers.cc:597] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.757015 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:14.758049 14089 tablet_replica.cc:333] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.759012 14089 raft_consensus.cc:2243] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.759667 14089 raft_consensus.cc:2272] T 7ad26ab3f81f457890e164908be52f74 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.762303 14089 tablet_replica.cc:333] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.763098 14089 raft_consensus.cc:2243] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.763849 14089 raft_consensus.cc:2272] T d83cd76a3c124667a5c4e76abfdcb0e6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.767037 14089 tablet_replica.cc:333] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.767786 14089 raft_consensus.cc:2243] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.768894 14089 raft_consensus.cc:2272] T 10d6363b9945401d80e4d6901e403c1b P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.771188 14089 tablet_replica.cc:333] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.772022 14089 raft_consensus.cc:2243] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.772949 14089 raft_consensus.cc:2272] T 243f1be44dc24698bb4e8556f40e21d3 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.775249 14089 tablet_replica.cc:333] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.775878 14089 raft_consensus.cc:2243] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.776747 14089 raft_consensus.cc:2272] T e55acce968e24f25b46b388a4fc2c773 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.779068 14089 tablet_replica.cc:333] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.779738 14089 raft_consensus.cc:2243] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.780225 14089 raft_consensus.cc:2272] T 3165dd57af4a455d83facbd02fcb4b80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.784019 14089 tablet_replica.cc:333] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.784889 14089 raft_consensus.cc:2243] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.785358 14089 raft_consensus.cc:2272] T 9202773444f2496c9bbc700a0b3a85f6 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.787318 14089 tablet_replica.cc:333] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.787854 14089 raft_consensus.cc:2243] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.788345 14089 raft_consensus.cc:2272] T 6dd8fa6771ed43a38e4769a0d1863183 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.790359 14089 tablet_replica.cc:333] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.790867 14089 raft_consensus.cc:2243] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.791316 14089 raft_consensus.cc:2272] T e2a071c31ac54253b3abf1a4dd962735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.793540 14089 tablet_replica.cc:333] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.794204 14089 raft_consensus.cc:2243] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.795097 14089 raft_consensus.cc:2272] T c3675b3fa6c6432984d1f5cfd34fd873 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.796981 14089 tablet_replica.cc:333] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.797670 14089 raft_consensus.cc:2243] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.798369 14089 raft_consensus.cc:2272] T 2914abdfc16e44c98c0e73c8c82e4c45 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.800603 14089 tablet_replica.cc:333] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.801379 14089 raft_consensus.cc:2243] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.802098 14089 raft_consensus.cc:2272] T 2706b5ec373d40a9bbf0d09ab72966d9 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.804322 14089 tablet_replica.cc:333] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.805049 14089 raft_consensus.cc:2243] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.805532 14089 raft_consensus.cc:2272] T c11524c3a8704cfdba261441ff2bed79 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.807430 14089 tablet_replica.cc:333] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.808033 14089 raft_consensus.cc:2243] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.808468 14089 raft_consensus.cc:2272] T 770d2fda022243328e17c46e34e5f4b5 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.810498 14089 tablet_replica.cc:333] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.810992 14089 raft_consensus.cc:2243] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.811393 14089 raft_consensus.cc:2272] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.814827 14089 tablet_replica.cc:333] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.815482 14089 raft_consensus.cc:2243] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.815903 14089 raft_consensus.cc:2272] T 0e64d88347b44f8e8c8f0aa30d129641 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.817694 14089 tablet_replica.cc:333] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.818344 14089 raft_consensus.cc:2243] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.819309 14089 raft_consensus.cc:2272] T 72a1146f3e714f4c9b68d5f668ce839c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:14.821462 15943 consensus_peers.cc:597] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.821611 14089 tablet_replica.cc:333] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.822453 14089 raft_consensus.cc:2243] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.823357 14089 raft_consensus.cc:2272] T 4526578d0507494e9dd2e42783b20ab7 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.825668 14089 tablet_replica.cc:333] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.826476 14089 raft_consensus.cc:2243] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.827230 14089 raft_consensus.cc:2272] T 9a39e92ebc0d4bc89814ec24579af33c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:14.827888 15435 consensus_peers.cc:597] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.829121 15435 consensus_peers.cc:597] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.829418 14089 tablet_replica.cc:333] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.830170 14089 raft_consensus.cc:2243] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.830935 14089 raft_consensus.cc:2272] T aff4e6978c594672a5ad5e2b9fe02d80 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.833137 14089 tablet_replica.cc:333] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.833861 14089 raft_consensus.cc:2243] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.834321 14089 raft_consensus.cc:2272] T e978370deeb04e9d85cf2cc3c936672b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.836370 14089 tablet_replica.cc:333] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.836908 14089 raft_consensus.cc:2243] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.837783 14089 raft_consensus.cc:2272] T 70006ed087454f3d92664b9822397752 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.840021 14089 tablet_replica.cc:333] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.840564 14089 raft_consensus.cc:2243] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.841295 14089 raft_consensus.cc:2272] T 86eab638067c49e79e1bdd4a3902cf7b P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.843595 14089 tablet_replica.cc:333] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.844175 14089 raft_consensus.cc:2243] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.845067 14089 raft_consensus.cc:2272] T 6ddc7ec3a25a454b880657949ea0b9da P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.847276 14089 tablet_replica.cc:333] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.848032 14089 raft_consensus.cc:2243] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.848968 14089 raft_consensus.cc:2272] T bb8029b5e36242caa04004ece3d1bb98 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.851521 14089 tablet_replica.cc:333] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.852249 14089 raft_consensus.cc:2243] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.853071 14089 raft_consensus.cc:2272] T 437ae8b0c2714e8985023ed0c9603d2a P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.855084 14089 tablet_replica.cc:333] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.855921 14089 raft_consensus.cc:2243] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.856477 14089 raft_consensus.cc:2272] T f5ecb583266e43b38c0deee2e253c52f P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.860719 14089 tablet_replica.cc:333] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.861474 14089 raft_consensus.cc:2243] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260201 08:59:14.861497 15361 consensus_peers.cc:597] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.862159 14089 raft_consensus.cc:2272] T 3ab6f302faf345749d3ea009054209cb P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.864586 14089 tablet_replica.cc:333] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.865401 14089 raft_consensus.cc:2243] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.865953 14089 raft_consensus.cc:2272] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.868438 14089 tablet_replica.cc:333] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.869024 14089 raft_consensus.cc:2243] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.869434 14089 raft_consensus.cc:2272] T 43ebb725235944919ca48499c364ba78 P 30f18d77acb94b73a5ef2abf32e480d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.871412 14089 tablet_replica.cc:333] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.871893 14089 raft_consensus.cc:2243] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.872687 14089 raft_consensus.cc:2272] T bfdb7fc00ac24ebc843ae2a3fe089389 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.874598 14089 tablet_replica.cc:333] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.875226 14089 raft_consensus.cc:2243] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.875941 14089 raft_consensus.cc:2272] T 5ea6d15904e84f4db55e93adfea29377 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.877943 14089 tablet_replica.cc:333] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.878494 14089 raft_consensus.cc:2243] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.878902 14089 raft_consensus.cc:2272] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 30f18d77acb94b73a5ef2abf32e480d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.881021 14089 tablet_replica.cc:333] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.881705 14089 raft_consensus.cc:2243] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.882257 14089 raft_consensus.cc:2272] T 3bc17c52abef44ba92ab2c0659577d3c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.884891 14089 tablet_replica.cc:333] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.885547 14089 raft_consensus.cc:2243] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.886087 14089 raft_consensus.cc:2272] T 1a6f3a1022c04fbea745045247de85a4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.888473 14089 tablet_replica.cc:333] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.889119 14089 raft_consensus.cc:2243] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.889746 14089 raft_consensus.cc:2272] T 3a58e5895d1541adabbfb02b14fa2735 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.891964 14089 tablet_replica.cc:333] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.892472 14089 raft_consensus.cc:2243] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.892988 14089 raft_consensus.cc:2272] T 74dd5038caeb4002a7029db349d2d5ea P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.895202 14089 tablet_replica.cc:333] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.895828 14089 raft_consensus.cc:2243] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.896240 14089 raft_consensus.cc:2272] T 46ee294a812241f3a8153b898b24e7c4 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.898864 14089 tablet_replica.cc:333] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.899394 14089 raft_consensus.cc:2243] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.899883 14089 raft_consensus.cc:2272] T 611e2cdf949d4159bce7bcd1606d9604 P 30f18d77acb94b73a5ef2abf32e480d3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.902959 14089 tablet_replica.cc:333] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.903676 14089 raft_consensus.cc:2243] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:14.904564 14089 raft_consensus.cc:2272] T 8cce9e137d99477387581030f09ca781 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:14.905453 15435 consensus_peers.cc:597] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:14.906833 14089 tablet_replica.cc:333] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.907385 14089 raft_consensus.cc:2243] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.907912 14089 raft_consensus.cc:2272] T edba8ca9af3f45589c3bf2437e521a27 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.909950 14089 tablet_replica.cc:333] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.910458 14089 raft_consensus.cc:2243] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.910852 14089 raft_consensus.cc:2272] T 10bddef534db4c1a811007e65a553a1c P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.913236 14089 tablet_replica.cc:333] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.913889 14089 raft_consensus.cc:2243] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.914536 14089 raft_consensus.cc:2272] T 8ad471d716964e0ca752941d6b983477 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.916714 14089 tablet_replica.cc:333] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.917212 14089 raft_consensus.cc:2243] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.917589 14089 raft_consensus.cc:2272] T f803005bcce24dbea779215746b9d2ca P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.919783 14089 tablet_replica.cc:333] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.920351 14089 raft_consensus.cc:2243] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.920850 14089 raft_consensus.cc:2272] T 522cf687b901401fbb953840208dd405 P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:14.922638 14089 tablet_replica.cc:333] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3: stopping tablet replica
I20260201 08:59:14.923169 14089 raft_consensus.cc:2243] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:14.923650 14089 raft_consensus.cc:2272] T 17706b520675450192459a881b96a1ce P 30f18d77acb94b73a5ef2abf32e480d3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:14.933697 15361 consensus_peers.cc:597] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.940315 15435 consensus_peers.cc:597] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.942420 15943 consensus_peers.cc:597] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.947154 15361 consensus_peers.cc:597] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.971354 15943 consensus_peers.cc:597] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.989485 15361 consensus_peers.cc:597] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:14.997318 15361 consensus_peers.cc:597] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.007055 15435 consensus_peers.cc:597] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.021529 15361 consensus_peers.cc:597] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.027092 14089 tablet_server.cc:195] TabletServer@127.13.194.65:0 shutdown complete.
W20260201 08:59:15.032656 15361 consensus_peers.cc:597] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.043690 15435 consensus_peers.cc:597] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.051119 15435 consensus_peers.cc:597] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.062837 15943 consensus_peers.cc:597] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.063913 15361 consensus_peers.cc:597] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.065933 16925 ts_tablet_manager.cc:933] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:15.068329 16925 tablet_copy_client.cc:323] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.67:39459
I20260201 08:59:15.071209 15479 tablet_copy_service.cc:140] P e3f02001764a476e95c2584a094fa7d6: Received BeginTabletCopySession request for tablet a3cde26b6b4d4157a86e3c2b67ca2d72 from peer a87a3e28e16f46a2ae235d381d0b4520 ({username='slave'} at 127.0.0.1:40888)
I20260201 08:59:15.071758 15479 tablet_copy_service.cc:161] P e3f02001764a476e95c2584a094fa7d6: Beginning new tablet copy session on tablet a3cde26b6b4d4157a86e3c2b67ca2d72 from peer a87a3e28e16f46a2ae235d381d0b4520 at {username='slave'} at 127.0.0.1:40888: session id = a87a3e28e16f46a2ae235d381d0b4520-a3cde26b6b4d4157a86e3c2b67ca2d72
I20260201 08:59:15.079267 15479 tablet_copy_source_session.cc:215] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260201 08:59:15.082957 16925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cde26b6b4d4157a86e3c2b67ca2d72. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:59:15.086961 15435 consensus_peers.cc:597] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.101078 16925 tablet_copy_client.cc:806] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 0 data blocks...
I20260201 08:59:15.101846 16925 tablet_copy_client.cc:670] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Starting download of 1 WAL segments...
W20260201 08:59:15.105448 15361 consensus_peers.cc:597] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.107919 16925 tablet_copy_client.cc:538] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260201 08:59:15.115049 15943 consensus_peers.cc:597] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.120939 16925 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap starting.
I20260201 08:59:15.144364 14089 tablet_server.cc:178] TabletServer@127.13.194.66:0 shutting down...
I20260201 08:59:15.147352 16925 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:15.148422 16925 tablet_bootstrap.cc:492] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: Bootstrap complete.
I20260201 08:59:15.149302 16925 ts_tablet_manager.cc:1403] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: Time spent bootstrapping tablet: real 0.029s user 0.017s sys 0.008s
I20260201 08:59:15.151175 16928 ts_tablet_manager.cc:933] T c2f539e5f0bc47eeb6b625d9cdfc7327 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
I20260201 08:59:15.155012 16925 raft_consensus.cc:359] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
W20260201 08:59:15.156877 15943 consensus_peers.cc:597] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.158470 16925 raft_consensus.cc:740] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a87a3e28e16f46a2ae235d381d0b4520, State: Initialized, Role: LEARNER
I20260201 08:59:15.159116 16925 consensus_queue.cc:260] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } attrs { replace: true } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: NON_VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: true } }
I20260201 08:59:15.162199 16925 ts_tablet_manager.cc:1434] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260201 08:59:15.165997 15479 tablet_copy_service.cc:342] P e3f02001764a476e95c2584a094fa7d6: Request end of tablet copy session a87a3e28e16f46a2ae235d381d0b4520-a3cde26b6b4d4157a86e3c2b67ca2d72 received from {username='slave'} at 127.0.0.1:40888
I20260201 08:59:15.166388 15479 tablet_copy_service.cc:434] P e3f02001764a476e95c2584a094fa7d6: ending tablet copy session a87a3e28e16f46a2ae235d381d0b4520-a3cde26b6b4d4157a86e3c2b67ca2d72 on tablet a3cde26b6b4d4157a86e3c2b67ca2d72 with peer a87a3e28e16f46a2ae235d381d0b4520
W20260201 08:59:15.170408 15266 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 08:59:15.170754 15266 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260201 08:59:15.172348 16928 tablet_copy_client.cc:323] T c2f539e5f0bc47eeb6b625d9cdfc7327 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
W20260201 08:59:15.175480 15361 consensus_peers.cc:597] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.180167 15941 consensus_peers.cc:597] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.190685 16925 ts_tablet_manager.cc:933] T 46ee294a812241f3a8153b898b24e7c4 P a87a3e28e16f46a2ae235d381d0b4520: Initiating tablet copy from peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
W20260201 08:59:15.195906 15941 consensus_peers.cc:597] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.197664 15266 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 08:59:15.198019 15266 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 08:59:15.203003 15361 consensus_peers.cc:597] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.205276 16925 tablet_copy_client.cc:323] T 46ee294a812241f3a8153b898b24e7c4 P a87a3e28e16f46a2ae235d381d0b4520: tablet copy: Beginning tablet copy session from remote peer at address 127.13.194.66:45593
I20260201 08:59:15.217080 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:15.218051 14089 tablet_replica.cc:333] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.218706 14089 raft_consensus.cc:2243] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.219226 14089 raft_consensus.cc:2272] T 7ad26ab3f81f457890e164908be52f74 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.221808 14089 tablet_replica.cc:333] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.222460 14089 raft_consensus.cc:2243] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.222880 14089 raft_consensus.cc:2272] T 10d6363b9945401d80e4d6901e403c1b P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.224903 15361 consensus_peers.cc:597] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.225088 14089 tablet_replica.cc:333] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.225756 14089 raft_consensus.cc:2243] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.226442 14089 raft_consensus.cc:2272] T 9202773444f2496c9bbc700a0b3a85f6 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.228674 14089 tablet_replica.cc:333] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.229619 14089 raft_consensus.cc:2243] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.230209 14089 raft_consensus.cc:2272] T 3165dd57af4a455d83facbd02fcb4b80 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.233763 14089 tablet_replica.cc:333] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.234455 14089 raft_consensus.cc:2243] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.236228 14089 raft_consensus.cc:2272] T 243f1be44dc24698bb4e8556f40e21d3 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.236307 15943 consensus_peers.cc:597] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.238292 14089 tablet_replica.cc:333] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.238929 14089 raft_consensus.cc:2243] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.239428 14089 raft_consensus.cc:2272] T de818d695150438d84ff5feff7a448c6 P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.241680 14089 tablet_replica.cc:333] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.242514 14089 raft_consensus.cc:2243] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.243482 14089 raft_consensus.cc:2272] T 770d2fda022243328e17c46e34e5f4b5 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.245937 14089 tablet_replica.cc:333] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.246517 14089 raft_consensus.cc:2243] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.246991 14089 raft_consensus.cc:2272] T a3cde26b6b4d4157a86e3c2b67ca2d72 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.249138 14089 tablet_replica.cc:333] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.249897 14089 raft_consensus.cc:2243] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.250459 14089 raft_consensus.cc:2272] T 701bd49fcb3346a0873fe568317002e8 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.252882 14089 tablet_replica.cc:333] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
W20260201 08:59:15.253046 15941 consensus_peers.cc:597] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.257036 14089 raft_consensus.cc:2243] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.257552 14089 raft_consensus.cc:2272] T 491c0efe7c624b5f98f4894361bf6e68 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.259591 14089 tablet_replica.cc:333] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.260197 14089 raft_consensus.cc:2243] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.260913 14089 raft_consensus.cc:2272] T 6dd8fa6771ed43a38e4769a0d1863183 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.263011 14089 tablet_replica.cc:333] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.263551 14089 raft_consensus.cc:2243] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.264031 14089 raft_consensus.cc:2272] T e2a071c31ac54253b3abf1a4dd962735 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.267022 14089 tablet_replica.cc:333] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
W20260201 08:59:15.267812 15433 consensus_peers.cc:597] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.267824 14089 raft_consensus.cc:2243] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.268718 14089 raft_consensus.cc:2272] T 0e64d88347b44f8e8c8f0aa30d129641 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.269002 15943 consensus_peers.cc:597] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Couldn't send request to peer 30f18d77acb94b73a5ef2abf32e480d3. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.270509 14089 tablet_replica.cc:333] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.271063 14089 raft_consensus.cc:2243] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.271660 14089 raft_consensus.cc:2272] T 72a1146f3e714f4c9b68d5f668ce839c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.273782 14089 tablet_replica.cc:333] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.274565 14089 raft_consensus.cc:2243] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.275482 14089 raft_consensus.cc:2272] T bc5ab607d0114b979fafd03b2cd64b82 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.277566 14089 tablet_replica.cc:333] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.278107 14089 raft_consensus.cc:2243] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.278520 14089 raft_consensus.cc:2272] T 15ac6b4592d14c9085fa39e7b3613e9b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.281131 14089 tablet_replica.cc:333] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.281968 14089 raft_consensus.cc:2243] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.282804 14089 raft_consensus.cc:2272] T aff4e6978c594672a5ad5e2b9fe02d80 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.289250 14089 tablet_replica.cc:333] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
W20260201 08:59:15.289196 15433 consensus_peers.cc:597] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.290221 14089 raft_consensus.cc:2243] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
W20260201 08:59:15.290485 15433 consensus_peers.cc:597] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.291157 14089 raft_consensus.cc:2272] T e978370deeb04e9d85cf2cc3c936672b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.293567 14089 tablet_replica.cc:333] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.294370 14089 raft_consensus.cc:2243] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.294962 14089 raft_consensus.cc:2272] T 70006ed087454f3d92664b9822397752 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.296506 15941 consensus_peers.cc:597] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.297133 14089 tablet_replica.cc:333] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.297701 14089 raft_consensus.cc:2243] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.298097 14089 raft_consensus.cc:2272] T 6bd7a5722773409789e77823ae3e57e9 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.299880 14089 tablet_replica.cc:333] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.300402 14089 raft_consensus.cc:2243] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 4 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.301230 14089 raft_consensus.cc:2272] T 43ebb725235944919ca48499c364ba78 P 544080112cc84e33ae3530baadd1d0dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.303105 14089 tablet_replica.cc:333] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.303812 14089 raft_consensus.cc:2243] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.304488 14089 raft_consensus.cc:2272] T baa1e353775e4af5a659c0d25dc5d48b P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.306612 14089 tablet_replica.cc:333] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.307349 14089 raft_consensus.cc:2243] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.307862 14089 raft_consensus.cc:2272] T 6ddc7ec3a25a454b880657949ea0b9da P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.310202 14089 tablet_replica.cc:333] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.310843 14089 raft_consensus.cc:2243] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.311331 14089 raft_consensus.cc:2272] T 3ab6f302faf345749d3ea009054209cb P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.313373 14089 tablet_replica.cc:333] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.313962 14089 raft_consensus.cc:2243] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.315104 14089 raft_consensus.cc:2272] T c2f539e5f0bc47eeb6b625d9cdfc7327 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.317608 14089 tablet_replica.cc:333] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.318145 14089 raft_consensus.cc:2243] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.318538 14089 raft_consensus.cc:2272] T 437ae8b0c2714e8985023ed0c9603d2a P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.320353 14089 tablet_replica.cc:333] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.321018 14089 raft_consensus.cc:2243] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.321498 14089 raft_consensus.cc:2272] T bb8029b5e36242caa04004ece3d1bb98 P 544080112cc84e33ae3530baadd1d0dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.323222 14089 tablet_replica.cc:333] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.323886 14089 raft_consensus.cc:2243] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.324779 14089 raft_consensus.cc:2272] T f5ecb583266e43b38c0deee2e253c52f P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.327062 14089 tablet_replica.cc:333] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.327595 14089 raft_consensus.cc:2243] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.328372 14089 raft_consensus.cc:2272] T 3bc17c52abef44ba92ab2c0659577d3c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.334451 14089 tablet_replica.cc:333] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.335220 14089 raft_consensus.cc:2243] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.336134 14089 raft_consensus.cc:2272] T 9a39e92ebc0d4bc89814ec24579af33c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.339795 15941 consensus_peers.cc:597] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.338428 14089 tablet_replica.cc:333] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.341614 14089 raft_consensus.cc:2243] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.342310 14089 raft_consensus.cc:2272] T d06ae7b6994d4f5a99bb33b73a0719d0 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.344342 14089 tablet_replica.cc:333] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.345073 14089 raft_consensus.cc:2243] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.346094 14089 raft_consensus.cc:2272] T 11b460db7c0c4e2a8c257d149e4d4111 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.348467 14089 tablet_replica.cc:333] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.349288 14089 raft_consensus.cc:2243] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.349829 14089 raft_consensus.cc:2272] T f8e27f1a110b46768ce90a7cf579c5c7 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.352286 14089 tablet_replica.cc:333] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.353001 14089 raft_consensus.cc:2243] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.354080 14089 raft_consensus.cc:2272] T 46ee294a812241f3a8153b898b24e7c4 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.356778 14089 tablet_replica.cc:333] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.357568 14089 raft_consensus.cc:2243] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.358309 14089 raft_consensus.cc:2272] T 8cce9e137d99477387581030f09ca781 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.360589 14089 tablet_replica.cc:333] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.362071 14089 raft_consensus.cc:2243] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 3 LEADER]: Raft consensus shutting down.
W20260201 08:59:15.362268 15433 consensus_peers.cc:597] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.363066 14089 raft_consensus.cc:2272] T f5f5d6cd697b47e9902f4fc7e8b5f02d P 544080112cc84e33ae3530baadd1d0dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.365507 14089 tablet_replica.cc:333] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.366211 14089 raft_consensus.cc:2243] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.366685 14089 raft_consensus.cc:2272] T 8085f989cb7c433b9306a89ddf9cf36b P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.368700 14089 tablet_replica.cc:333] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.369388 14089 raft_consensus.cc:2243] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.369836 14089 raft_consensus.cc:2272] T 1a6f3a1022c04fbea745045247de85a4 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.371937 14089 tablet_replica.cc:333] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.372623 14089 raft_consensus.cc:2243] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.373181 14089 raft_consensus.cc:2272] T 74dd5038caeb4002a7029db349d2d5ea P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.375427 14089 tablet_replica.cc:333] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.376030 14089 raft_consensus.cc:2243] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.376456 14089 raft_consensus.cc:2272] T c37d9e5e810f4cde8bf85667cc298883 P 544080112cc84e33ae3530baadd1d0dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.378799 14089 tablet_replica.cc:333] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.379457 14089 raft_consensus.cc:2243] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.380038 14089 raft_consensus.cc:2272] T 601eb231d2e943dcb0d893b620bbf937 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.382467 14089 tablet_replica.cc:333] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.382939 14089 raft_consensus.cc:2243] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.383888 14089 raft_consensus.cc:2272] T 8ad471d716964e0ca752941d6b983477 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.386265 15433 consensus_peers.cc:597] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.386500 14089 tablet_replica.cc:333] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.387218 14089 raft_consensus.cc:2243] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.387672 14089 raft_consensus.cc:2272] T f803005bcce24dbea779215746b9d2ca P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.389818 14089 tablet_replica.cc:333] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.390383 14089 raft_consensus.cc:2243] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.391193 14089 raft_consensus.cc:2272] T edba8ca9af3f45589c3bf2437e521a27 P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.393497 14089 tablet_replica.cc:333] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd: stopping tablet replica
I20260201 08:59:15.394083 14089 raft_consensus.cc:2243] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.394583 14089 raft_consensus.cc:2272] T 10bddef534db4c1a811007e65a553a1c P 544080112cc84e33ae3530baadd1d0dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.396440 15941 consensus_peers.cc:597] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.434741 15433 consensus_peers.cc:597] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.436129 15433 consensus_peers.cc:597] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.444327 15433 consensus_peers.cc:597] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.469288 15941 consensus_peers.cc:597] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.472241 15941 connection.cc:537] client connection to 127.13.194.66:45593 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260201 08:59:15.473450 15940 connection.cc:441] server connection from 127.0.0.1:39782 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39782 (request call id 455) could send its response
I20260201 08:59:15.488339 14089 tablet_server.cc:195] TabletServer@127.13.194.66:0 shutdown complete.
W20260201 08:59:15.499354 15433 consensus_peers.cc:597] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.66:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.516023 15433 consensus_peers.cc:597] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.66:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.538923 15941 consensus_peers.cc:597] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.66:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.541517 15433 consensus_peers.cc:597] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.66:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.599172 15433 consensus_peers.cc:597] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.66:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.620139 14089 tablet_server.cc:178] TabletServer@127.13.194.67:0 shutting down...
W20260201 08:59:15.625054 15266 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 08:59:15.625361 15266 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 08:59:15.642015 15943 consensus_peers.cc:597] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.647962 15976 raft_consensus.cc:1217] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260201 08:59:15.659166 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:15.659893 14089 tablet_replica.cc:333] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.660567 14089 raft_consensus.cc:2243] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.661100 14089 raft_consensus.cc:2272] T 10d6363b9945401d80e4d6901e403c1b P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.662859 14089 tablet_replica.cc:333] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.663403 14089 raft_consensus.cc:2243] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.663918 14089 raft_consensus.cc:2272] T e55acce968e24f25b46b388a4fc2c773 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.665717 14089 tablet_replica.cc:333] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.666322 14089 raft_consensus.cc:2243] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.666767 14089 raft_consensus.cc:2272] T d83cd76a3c124667a5c4e76abfdcb0e6 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.668619 14089 tablet_replica.cc:333] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.669410 14089 raft_consensus.cc:2243] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260201 08:59:15.669416 15941 consensus_peers.cc:597] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Couldn't send request to peer 544080112cc84e33ae3530baadd1d0dd. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.66:45593: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.670003 14089 raft_consensus.cc:2272] T 243f1be44dc24698bb4e8556f40e21d3 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.672092 14089 tablet_replica.cc:333] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.672767 14089 raft_consensus.cc:2243] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 LEADER]: Raft consensus shutting down.
W20260201 08:59:15.673166 15940 connection.cc:441] server connection from 127.0.0.1:39782 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:39782 (request call id 454) could send its response
I20260201 08:59:15.673707 14089 raft_consensus.cc:2272] T de818d695150438d84ff5feff7a448c6 P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.675542 14089 tablet_replica.cc:333] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.676194 14089 raft_consensus.cc:2243] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.676618 14089 raft_consensus.cc:2272] T 6dd8fa6771ed43a38e4769a0d1863183 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.678702 14089 tablet_replica.cc:333] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
W20260201 08:59:15.678936 15943 consensus_peers.cc:597] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.679417 14089 raft_consensus.cc:2243] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.680123 14089 raft_consensus.cc:2272] T e2a071c31ac54253b3abf1a4dd962735 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.681800 14089 tablet_replica.cc:333] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.682271 14089 raft_consensus.cc:2243] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.682623 14089 raft_consensus.cc:2272] T c3675b3fa6c6432984d1f5cfd34fd873 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.684131 14089 tablet_replica.cc:333] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.684617 14089 raft_consensus.cc:2243] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.685030 14089 raft_consensus.cc:2272] T 491c0efe7c624b5f98f4894361bf6e68 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.686672 14089 tablet_replica.cc:333] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.687124 14089 raft_consensus.cc:2243] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.687472 14089 raft_consensus.cc:2272] T bc5ab607d0114b979fafd03b2cd64b82 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.689013 14089 tablet_replica.cc:333] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.689468 14089 raft_consensus.cc:2243] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.689803 14089 raft_consensus.cc:2272] T 2914abdfc16e44c98c0e73c8c82e4c45 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.691407 14089 tablet_replica.cc:333] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.691872 14089 raft_consensus.cc:2243] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.692502 14089 raft_consensus.cc:2272] T 2706b5ec373d40a9bbf0d09ab72966d9 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.694134 14089 tablet_replica.cc:333] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.694685 14089 raft_consensus.cc:2243] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.695271 14089 raft_consensus.cc:2272] T c11524c3a8704cfdba261441ff2bed79 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.697216 14089 tablet_replica.cc:333] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.697980 14089 raft_consensus.cc:2243] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.699765 14089 raft_consensus.cc:2272] T 15ac6b4592d14c9085fa39e7b3613e9b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.702073 14089 tablet_replica.cc:333] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.702841 14089 raft_consensus.cc:2243] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.703320 14089 raft_consensus.cc:2272] T 6bd7a5722773409789e77823ae3e57e9 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.705487 14089 tablet_replica.cc:333] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.705982 14089 raft_consensus.cc:2243] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.706377 14089 raft_consensus.cc:2272] T 4526578d0507494e9dd2e42783b20ab7 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.707979 14089 tablet_replica.cc:333] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.708575 14089 raft_consensus.cc:2243] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.709136 14089 raft_consensus.cc:2272] T 770d2fda022243328e17c46e34e5f4b5 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.711622 14089 tablet_replica.cc:333] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.712416 14089 raft_consensus.cc:2243] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.713068 14089 raft_consensus.cc:2272] T 701bd49fcb3346a0873fe568317002e8 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.715265 14089 tablet_replica.cc:333] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.715751 14089 raft_consensus.cc:2243] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.716679 14089 raft_consensus.cc:2272] T a3cde26b6b4d4157a86e3c2b67ca2d72 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.718317 14089 tablet_replica.cc:333] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.718815 14089 raft_consensus.cc:2243] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.719225 14089 raft_consensus.cc:2272] T 43ebb725235944919ca48499c364ba78 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.721290 14089 tablet_replica.cc:333] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.721962 14089 raft_consensus.cc:2243] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.722879 14089 raft_consensus.cc:2272] T baa1e353775e4af5a659c0d25dc5d48b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.725484 14089 tablet_replica.cc:333] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.725843 16901 raft_consensus.cc:493] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 30f18d77acb94b73a5ef2abf32e480d3)
I20260201 08:59:15.726325 16901 raft_consensus.cc:515] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:15.727133 14089 raft_consensus.cc:2243] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.727806 14089 raft_consensus.cc:2272] T e978370deeb04e9d85cf2cc3c936672b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.728147 16901 leader_election.cc:290] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
I20260201 08:59:15.730126 14089 tablet_replica.cc:333] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.731123 14089 raft_consensus.cc:2243] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.731868 14089 raft_consensus.cc:2272] T 86eab638067c49e79e1bdd4a3902cf7b P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.732748 15943 leader_election.cc:336] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 08:59:15.733364 15943 leader_election.cc:336] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111)
I20260201 08:59:15.733723 15943 leader_election.cc:304] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:15.734277 14089 tablet_replica.cc:333] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.734416 16901 raft_consensus.cc:2749] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:15.735042 14089 raft_consensus.cc:2243] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.735659 14089 raft_consensus.cc:2272] T 11b460db7c0c4e2a8c257d149e4d4111 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.737355 14089 tablet_replica.cc:333] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.737870 14089 raft_consensus.cc:2243] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.738543 14089 raft_consensus.cc:2272] T f8e27f1a110b46768ce90a7cf579c5c7 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.740219 14089 tablet_replica.cc:333] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.740703 14089 raft_consensus.cc:2243] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.741137 14089 raft_consensus.cc:2272] T 46ee294a812241f3a8153b898b24e7c4 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.742746 14089 tablet_replica.cc:333] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.743229 14089 raft_consensus.cc:2243] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.743600 14089 raft_consensus.cc:2272] T 437ae8b0c2714e8985023ed0c9603d2a P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.745267 14089 tablet_replica.cc:333] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.745769 14089 raft_consensus.cc:2243] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.746122 14089 raft_consensus.cc:2272] T bb8029b5e36242caa04004ece3d1bb98 P e3f02001764a476e95c2584a094fa7d6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.747902 14089 tablet_replica.cc:333] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.748521 14089 raft_consensus.cc:2243] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.749315 14089 raft_consensus.cc:2272] T d06ae7b6994d4f5a99bb33b73a0719d0 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.751502 14089 tablet_replica.cc:333] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.751986 14089 raft_consensus.cc:2243] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.752318 14089 raft_consensus.cc:2272] T 611e2cdf949d4159bce7bcd1606d9604 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.753893 14089 tablet_replica.cc:333] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.754345 14089 raft_consensus.cc:2243] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.754843 14089 raft_consensus.cc:2272] T bfdb7fc00ac24ebc843ae2a3fe089389 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.756304 14089 tablet_replica.cc:333] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.756754 14089 raft_consensus.cc:2243] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.757318 14089 raft_consensus.cc:2272] T 5ea6d15904e84f4db55e93adfea29377 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.758857 14089 tablet_replica.cc:333] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.759310 14089 raft_consensus.cc:2243] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.759970 14089 raft_consensus.cc:2272] T 3ab6f302faf345749d3ea009054209cb P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.761602 14089 tablet_replica.cc:333] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.762063 14089 raft_consensus.cc:2243] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.762446 14089 raft_consensus.cc:2272] T c2f539e5f0bc47eeb6b625d9cdfc7327 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.764063 14089 tablet_replica.cc:333] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.764479 14089 raft_consensus.cc:2243] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.764798 14089 raft_consensus.cc:2272] T 3bc17c52abef44ba92ab2c0659577d3c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.766396 14089 tablet_replica.cc:333] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.766853 14089 raft_consensus.cc:2243] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.767204 14089 raft_consensus.cc:2272] T f5f5d6cd697b47e9902f4fc7e8b5f02d P e3f02001764a476e95c2584a094fa7d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.768950 14089 tablet_replica.cc:333] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.769405 14089 raft_consensus.cc:2243] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.770079 14089 raft_consensus.cc:2272] T 8085f989cb7c433b9306a89ddf9cf36b P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.771636 14089 tablet_replica.cc:333] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.772061 14089 raft_consensus.cc:2243] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.772400 14089 raft_consensus.cc:2272] T 3a58e5895d1541adabbfb02b14fa2735 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.774111 14089 tablet_replica.cc:333] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.774591 14089 raft_consensus.cc:2243] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.775142 14089 raft_consensus.cc:2272] T c37d9e5e810f4cde8bf85667cc298883 P e3f02001764a476e95c2584a094fa7d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.776947 14089 tablet_replica.cc:333] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.777392 14089 raft_consensus.cc:2243] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.778051 14089 raft_consensus.cc:2272] T 522cf687b901401fbb953840208dd405 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.780234 14089 tablet_replica.cc:333] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.780934 14089 raft_consensus.cc:2243] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.781908 14089 raft_consensus.cc:2272] T 601eb231d2e943dcb0d893b620bbf937 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.784248 14089 tablet_replica.cc:333] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.784929 14089 raft_consensus.cc:2243] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.785900 14089 raft_consensus.cc:2272] T 17706b520675450192459a881b96a1ce P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:15.785672 15943 consensus_peers.cc:597] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.788445 14089 tablet_replica.cc:333] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.789170 14089 raft_consensus.cc:2243] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.790074 14089 raft_consensus.cc:2272] T f803005bcce24dbea779215746b9d2ca P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.791728 14089 tablet_replica.cc:333] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.792130 14089 raft_consensus.cc:2243] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:15.792791 14089 raft_consensus.cc:2272] T 10bddef534db4c1a811007e65a553a1c P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.794497 14089 tablet_replica.cc:333] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6: stopping tablet replica
I20260201 08:59:15.794929 14089 raft_consensus.cc:2243] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.795249 14089 raft_consensus.cc:2272] T edba8ca9af3f45589c3bf2437e521a27 P e3f02001764a476e95c2584a094fa7d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.839735 16901 raft_consensus.cc:493] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 30f18d77acb94b73a5ef2abf32e480d3)
I20260201 08:59:15.840227 16901 raft_consensus.cc:515] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
W20260201 08:59:15.841323 15943 consensus_peers.cc:597] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.841923 16901 leader_election.cc:290] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
W20260201 08:59:15.847043 15943 leader_election.cc:336] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 08:59:15.848428 15943 leader_election.cc:336] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111)
I20260201 08:59:15.848834 15943 leader_election.cc:304] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:15.851830 16901 raft_consensus.cc:2749] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:15.863386 16901 raft_consensus.cc:493] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 30f18d77acb94b73a5ef2abf32e480d3)
I20260201 08:59:15.863938 16901 raft_consensus.cc:515] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "544080112cc84e33ae3530baadd1d0dd" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 45593 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:15.865864 16901 leader_election.cc:290] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593)
W20260201 08:59:15.870196 15943 leader_election.cc:336] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111)
W20260201 08:59:15.871191 15941 leader_election.cc:336] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 544080112cc84e33ae3530baadd1d0dd (127.13.194.66:45593): Network error: Client connection negotiation failed: client connection to 127.13.194.66:45593: connect: Connection refused (error 111)
I20260201 08:59:15.871634 15941 leader_election.cc:304] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520; no voters: 30f18d77acb94b73a5ef2abf32e480d3, 544080112cc84e33ae3530baadd1d0dd
I20260201 08:59:15.872215 16901 raft_consensus.cc:2749] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:15.885627 14089 tablet_server.cc:195] TabletServer@127.13.194.67:0 shutdown complete.
W20260201 08:59:15.893415 15943 consensus_peers.cc:597] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.67:39459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.893914 15943 consensus_peers.cc:597] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.67:39459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.907893 15943 consensus_peers.cc:597] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.67:39459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:15.941507 16901 raft_consensus.cc:493] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 30f18d77acb94b73a5ef2abf32e480d3)
I20260201 08:59:15.942036 16901 raft_consensus.cc:515] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "30f18d77acb94b73a5ef2abf32e480d3" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 41253 } } peers { permanent_uuid: "e3f02001764a476e95c2584a094fa7d6" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 39459 } } peers { permanent_uuid: "a87a3e28e16f46a2ae235d381d0b4520" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 37119 } attrs { promote: false } }
I20260201 08:59:15.944466 16901 leader_election.cc:290] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253), e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459)
W20260201 08:59:15.946537 15943 consensus_peers.cc:597] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 -> Peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Couldn't send request to peer e3f02001764a476e95c2584a094fa7d6. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.67:39459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:15.948570 15943 leader_election.cc:336] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 30f18d77acb94b73a5ef2abf32e480d3 (127.13.194.65:41253): Network error: Client connection negotiation failed: client connection to 127.13.194.65:41253: connect: Connection refused (error 111)
W20260201 08:59:15.949246 15943 leader_election.cc:336] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3f02001764a476e95c2584a094fa7d6 (127.13.194.67:39459): Network error: Client connection negotiation failed: client connection to 127.13.194.67:39459: connect: Connection refused (error 111)
I20260201 08:59:15.949540 15943 leader_election.cc:304] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a87a3e28e16f46a2ae235d381d0b4520; no voters: 30f18d77acb94b73a5ef2abf32e480d3, e3f02001764a476e95c2584a094fa7d6
I20260201 08:59:15.950139 16901 raft_consensus.cc:2749] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:15.963670 14089 tablet_server.cc:178] TabletServer@127.13.194.68:0 shutting down...
I20260201 08:59:15.992614 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:15.993417 14089 tablet_replica.cc:333] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:15.994212 14089 raft_consensus.cc:2243] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Raft consensus shutting down.
I20260201 08:59:15.994719 14089 raft_consensus.cc:2272] T a3cde26b6b4d4157a86e3c2b67ca2d72 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 LEARNER]: Raft consensus is shut down!
I20260201 08:59:15.996405 14089 tablet_replica.cc:333] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:15.997001 14089 raft_consensus.cc:2243] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.997452 14089 raft_consensus.cc:2272] T bfdb7fc00ac24ebc843ae2a3fe089389 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:15.999002 14089 tablet_replica.cc:333] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:15.999487 14089 raft_consensus.cc:2243] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:15.999876 14089 raft_consensus.cc:2272] T 4526578d0507494e9dd2e42783b20ab7 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.001456 14089 tablet_replica.cc:333] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.001946 14089 raft_consensus.cc:2243] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.002367 14089 raft_consensus.cc:2272] T 86eab638067c49e79e1bdd4a3902cf7b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.003845 14089 tablet_replica.cc:333] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.004333 14089 raft_consensus.cc:2243] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.004756 14089 raft_consensus.cc:2272] T aff4e6978c594672a5ad5e2b9fe02d80 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.006349 14089 tablet_replica.cc:333] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.006809 14089 raft_consensus.cc:2243] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.007228 14089 raft_consensus.cc:2272] T 70006ed087454f3d92664b9822397752 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.008884 14089 tablet_replica.cc:333] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.009689 14089 raft_consensus.cc:2243] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.010222 14089 raft_consensus.cc:2272] T 17706b520675450192459a881b96a1ce P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.012434 14089 tablet_replica.cc:333] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.013203 14089 raft_consensus.cc:2243] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.013614 14089 raft_consensus.cc:2272] T 8cce9e137d99477387581030f09ca781 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.015149 14089 tablet_replica.cc:333] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.015606 14089 raft_consensus.cc:2243] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.016240 14089 raft_consensus.cc:2272] T 6bd7a5722773409789e77823ae3e57e9 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.017889 14089 tablet_replica.cc:333] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.018339 14089 raft_consensus.cc:2243] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.018970 14089 raft_consensus.cc:2272] T 3165dd57af4a455d83facbd02fcb4b80 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.020469 14089 tablet_replica.cc:333] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.021006 14089 raft_consensus.cc:2243] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.021622 14089 raft_consensus.cc:2272] T d83cd76a3c124667a5c4e76abfdcb0e6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.023154 14089 tablet_replica.cc:333] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.023622 14089 raft_consensus.cc:2243] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.024051 14089 raft_consensus.cc:2272] T 9a39e92ebc0d4bc89814ec24579af33c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.025578 14089 tablet_replica.cc:333] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.026043 14089 raft_consensus.cc:2243] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.026454 14089 raft_consensus.cc:2272] T d06ae7b6994d4f5a99bb33b73a0719d0 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.027951 14089 tablet_replica.cc:333] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.028393 14089 raft_consensus.cc:2243] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.029073 14089 raft_consensus.cc:2272] T 0e64d88347b44f8e8c8f0aa30d129641 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.030570 14089 tablet_replica.cc:333] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.031044 14089 raft_consensus.cc:2243] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.031454 14089 raft_consensus.cc:2272] T 2706b5ec373d40a9bbf0d09ab72966d9 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.033062 14089 tablet_replica.cc:333] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.033500 14089 raft_consensus.cc:2243] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.033923 14089 raft_consensus.cc:2272] T 72a1146f3e714f4c9b68d5f668ce839c P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.035386 14089 tablet_replica.cc:333] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.035849 14089 raft_consensus.cc:2243] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.036475 14089 raft_consensus.cc:2272] T 1a6f3a1022c04fbea745045247de85a4 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.038115 14089 tablet_replica.cc:333] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.038580 14089 raft_consensus.cc:2243] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.038909 14089 raft_consensus.cc:2272] T 8085f989cb7c433b9306a89ddf9cf36b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.040427 14089 tablet_replica.cc:333] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.040953 14089 raft_consensus.cc:2243] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.041631 14089 raft_consensus.cc:2272] T c37d9e5e810f4cde8bf85667cc298883 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.043260 14089 tablet_replica.cc:333] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.043716 14089 raft_consensus.cc:2243] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.044341 14089 raft_consensus.cc:2272] T 2914abdfc16e44c98c0e73c8c82e4c45 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.045902 14089 tablet_replica.cc:333] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.046401 14089 raft_consensus.cc:2243] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.046840 14089 raft_consensus.cc:2272] T bc5ab607d0114b979fafd03b2cd64b82 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.048336 14089 tablet_replica.cc:333] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.048794 14089 raft_consensus.cc:2243] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.049456 14089 raft_consensus.cc:2272] T 74dd5038caeb4002a7029db349d2d5ea P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.051143 14089 tablet_replica.cc:333] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.051617 14089 raft_consensus.cc:2243] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.052273 14089 raft_consensus.cc:2272] T 3a58e5895d1541adabbfb02b14fa2735 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.053967 14089 tablet_replica.cc:333] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.054442 14089 raft_consensus.cc:2243] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.054792 14089 raft_consensus.cc:2272] T c3675b3fa6c6432984d1f5cfd34fd873 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.056354 14089 tablet_replica.cc:333] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.056834 14089 raft_consensus.cc:2243] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.057248 14089 raft_consensus.cc:2272] T baa1e353775e4af5a659c0d25dc5d48b P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.058889 14089 tablet_replica.cc:333] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.059350 14089 raft_consensus.cc:2243] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.059794 14089 raft_consensus.cc:2272] T 8ad471d716964e0ca752941d6b983477 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.061388 14089 tablet_replica.cc:333] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.061861 14089 raft_consensus.cc:2243] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.062506 14089 raft_consensus.cc:2272] T 701bd49fcb3346a0873fe568317002e8 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.064085 14089 tablet_replica.cc:333] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.064533 14089 raft_consensus.cc:2243] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.065244 14089 raft_consensus.cc:2272] T 491c0efe7c624b5f98f4894361bf6e68 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.066915 14089 tablet_replica.cc:333] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.067374 14089 raft_consensus.cc:2243] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.067822 14089 raft_consensus.cc:2272] T 5ea6d15904e84f4db55e93adfea29377 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.069468 14089 tablet_replica.cc:333] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.069942 14089 raft_consensus.cc:2243] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.070401 14089 raft_consensus.cc:2272] T de818d695150438d84ff5feff7a448c6 P a87a3e28e16f46a2ae235d381d0b4520 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.072026 14089 tablet_replica.cc:333] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.072536 14089 raft_consensus.cc:2243] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.073263 14089 raft_consensus.cc:2272] T 7ad26ab3f81f457890e164908be52f74 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.074898 14089 tablet_replica.cc:333] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.075403 14089 raft_consensus.cc:2243] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.075863 14089 raft_consensus.cc:2272] T e55acce968e24f25b46b388a4fc2c773 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.077483 14089 tablet_replica.cc:333] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.078078 14089 raft_consensus.cc:2243] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.078475 14089 raft_consensus.cc:2272] T 15ac6b4592d14c9085fa39e7b3613e9b P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.080130 14089 tablet_replica.cc:333] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.080622 14089 raft_consensus.cc:2243] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.081332 14089 raft_consensus.cc:2272] T c11524c3a8704cfdba261441ff2bed79 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.082940 14089 tablet_replica.cc:333] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.083412 14089 raft_consensus.cc:2243] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.083791 14089 raft_consensus.cc:2272] T 9202773444f2496c9bbc700a0b3a85f6 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.085399 14089 tablet_replica.cc:333] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.085880 14089 raft_consensus.cc:2243] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.086390 14089 raft_consensus.cc:2272] T 601eb231d2e943dcb0d893b620bbf937 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.088374 14089 tablet_replica.cc:333] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.088845 14089 raft_consensus.cc:2243] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.089275 14089 raft_consensus.cc:2272] T 522cf687b901401fbb953840208dd405 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.090848 14089 tablet_replica.cc:333] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.091301 14089 raft_consensus.cc:2243] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.091754 14089 raft_consensus.cc:2272] T f5ecb583266e43b38c0deee2e253c52f P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.093281 14089 tablet_replica.cc:333] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.093739 14089 raft_consensus.cc:2243] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.094149 14089 raft_consensus.cc:2272] T 11b460db7c0c4e2a8c257d149e4d4111 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.095911 14089 tablet_replica.cc:333] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.096386 14089 raft_consensus.cc:2243] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.096956 14089 raft_consensus.cc:2272] T 6ddc7ec3a25a454b880657949ea0b9da P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.098680 14089 tablet_replica.cc:333] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.099131 14089 raft_consensus.cc:2243] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.099831 14089 raft_consensus.cc:2272] T 611e2cdf949d4159bce7bcd1606d9604 P a87a3e28e16f46a2ae235d381d0b4520 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.101583 14089 tablet_replica.cc:333] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520: stopping tablet replica
I20260201 08:59:16.102036 14089 raft_consensus.cc:2243] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:16.102464 14089 raft_consensus.cc:2272] T f8e27f1a110b46768ce90a7cf579c5c7 P a87a3e28e16f46a2ae235d381d0b4520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.157510 14089 tablet_server.cc:195] TabletServer@127.13.194.68:0 shutdown complete.
I20260201 08:59:16.208572 14089 master.cc:561] Master@127.13.194.126:35057 shutting down...
I20260201 08:59:16.230871 14089 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:16.231416 14089 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:16.231724 14089 tablet_replica.cc:333] T 00000000000000000000000000000000 P 60d2b65f2b454c4bbb436aad84330f2e: stopping tablet replica
I20260201 08:59:16.251811 14089 master.cc:583] Master@127.13.194.126:35057 shutdown complete.
[ OK ] LeaderRebalancerTest.AddTserver (46314 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20260201 08:59:16.331976 14089 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.194.126:42773
I20260201 08:59:16.333220 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:16.338829 16935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.338846 16936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.340274 16938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:16.341037 14089 server_base.cc:1060] running on GCE node
I20260201 08:59:16.342145 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:16.342356 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:16.342494 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936356342477 us; error 0 us; skew 500 ppm
I20260201 08:59:16.342990 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:16.345283 14089 webserver.cc:492] Webserver started at http://127.13.194.126:35461/ using document root <none> and password file <none>
I20260201 08:59:16.345743 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:16.345933 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:16.346174 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:16.347260 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/master-0-root/instance:
uuid: "0d9a3591250040b0b07d71f8a9f3dd4c"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.351634 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260201 08:59:16.354992 16943 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.355705 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:16.355997 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/master-0-root
uuid: "0d9a3591250040b0b07d71f8a9f3dd4c"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.356259 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:16.387485 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:16.388711 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:16.426771 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.126:42773
I20260201 08:59:16.426872 16994 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.126:42773 every 8 connection(s)
I20260201 08:59:16.430433 16995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:16.440351 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Bootstrap starting.
I20260201 08:59:16.444885 16995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:16.449040 16995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: No bootstrap required, opened a new log
I20260201 08:59:16.451035 16995 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" member_type: VOTER }
I20260201 08:59:16.451406 16995 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:16.451642 16995 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9a3591250040b0b07d71f8a9f3dd4c, State: Initialized, Role: FOLLOWER
I20260201 08:59:16.452152 16995 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" member_type: VOTER }
I20260201 08:59:16.452592 16995 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 08:59:16.452821 16995 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 08:59:16.453107 16995 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:16.457321 16995 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" member_type: VOTER }
I20260201 08:59:16.457896 16995 leader_election.cc:304] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d9a3591250040b0b07d71f8a9f3dd4c; no voters:
I20260201 08:59:16.459115 16995 leader_election.cc:290] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 08:59:16.459496 16998 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:16.460808 16998 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [term 1 LEADER]: Becoming Leader. State: Replica: 0d9a3591250040b0b07d71f8a9f3dd4c, State: Running, Role: LEADER
I20260201 08:59:16.461481 16998 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" member_type: VOTER }
I20260201 08:59:16.461951 16995 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [sys.catalog]: configured and running, proceeding with master startup.
I20260201 08:59:16.465402 16999 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" member_type: VOTER } }
I20260201 08:59:16.465979 16999 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:16.468042 17000 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d9a3591250040b0b07d71f8a9f3dd4c. Latest consensus state: current_term: 1 leader_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9a3591250040b0b07d71f8a9f3dd4c" member_type: VOTER } }
I20260201 08:59:16.468353 17005 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 08:59:16.468513 17000 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c [sys.catalog]: This master's current role is: LEADER
I20260201 08:59:16.475632 17005 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 08:59:16.480983 14089 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 08:59:16.485204 17005 catalog_manager.cc:1357] Generated new cluster ID: 7b947f85e17d47d380b35d8bad145da3
I20260201 08:59:16.485435 17005 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 08:59:16.512199 17005 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 08:59:16.513401 17005 catalog_manager.cc:1514] Loading token signing keys...
I20260201 08:59:16.525532 17005 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Generated new TSK 0
I20260201 08:59:16.526100 17005 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 08:59:16.547065 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:16.552664 17016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.553906 17017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.555127 17019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:16.555994 14089 server_base.cc:1060] running on GCE node
I20260201 08:59:16.557005 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:16.557195 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:16.557334 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936356557319 us; error 0 us; skew 500 ppm
I20260201 08:59:16.557876 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:16.560148 14089 webserver.cc:492] Webserver started at http://127.13.194.65:34593/ using document root <none> and password file <none>
I20260201 08:59:16.560637 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:16.560817 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:16.561111 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:16.562186 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/instance:
uuid: "35484ac93d564e958f85965bd740a18f"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.566774 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260201 08:59:16.569980 17024 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.570703 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260201 08:59:16.570983 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
uuid: "35484ac93d564e958f85965bd740a18f"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.571244 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:16.579284 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:16.580430 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:16.581871 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:16.584050 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:16.584244 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.584455 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:16.584600 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.622217 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.65:45571
I20260201 08:59:16.622303 17086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.65:45571 every 8 connection(s)
I20260201 08:59:16.626709 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:16.633541 17091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.634248 17092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.636819 17094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:16.637331 14089 server_base.cc:1060] running on GCE node
I20260201 08:59:16.638301 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:16.638485 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:16.638609 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936356638598 us; error 0 us; skew 500 ppm
I20260201 08:59:16.639042 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:16.641508 14089 webserver.cc:492] Webserver started at http://127.13.194.66:35515/ using document root <none> and password file <none>
I20260201 08:59:16.642138 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:16.642365 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:16.642587 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:16.643312 17087 heartbeater.cc:344] Connected to a master server at 127.13.194.126:42773
I20260201 08:59:16.643679 17087 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:16.643795 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/instance:
uuid: "3dee892ea94d4f2a92316ad6f79edca2"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.644328 17087 heartbeater.cc:507] Master 127.13.194.126:42773 requested a full tablet report, sending...
I20260201 08:59:16.646385 16960 ts_manager.cc:194] Registered new tserver with Master: 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:16.648622 16960 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51046
I20260201 08:59:16.649096 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260201 08:59:16.652549 17099 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.653290 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 08:59:16.653535 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-1-root
uuid: "3dee892ea94d4f2a92316ad6f79edca2"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.653775 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:16.678429 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:16.679558 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:16.681058 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:16.683293 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:16.683480 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.683665 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:16.683786 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.721206 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.66:41977
I20260201 08:59:16.721295 17161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.66:41977 every 8 connection(s)
I20260201 08:59:16.725636 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:16.733155 17165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.733665 17166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.735834 17168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:16.737188 17162 heartbeater.cc:344] Connected to a master server at 127.13.194.126:42773
I20260201 08:59:16.737215 14089 server_base.cc:1060] running on GCE node
I20260201 08:59:16.737775 17162 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:16.738314 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:16.738552 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:16.738479 17162 heartbeater.cc:507] Master 127.13.194.126:42773 requested a full tablet report, sending...
I20260201 08:59:16.738848 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936356738829 us; error 0 us; skew 500 ppm
I20260201 08:59:16.739485 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:16.740515 16960 ts_manager.cc:194] Registered new tserver with Master: 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:16.741852 16960 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51048
I20260201 08:59:16.742141 14089 webserver.cc:492] Webserver started at http://127.13.194.67:45887/ using document root <none> and password file <none>
I20260201 08:59:16.742718 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:16.742918 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:16.743158 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:16.744155 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/instance:
uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.748281 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260201 08:59:16.751317 17173 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.751976 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260201 08:59:16.752236 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-2-root
uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.752485 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:16.761710 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:16.762792 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:16.764148 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:16.766263 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:16.766458 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.766702 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:16.766852 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.805359 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.67:33911
I20260201 08:59:16.805447 17235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.67:33911 every 8 connection(s)
I20260201 08:59:16.809813 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:16.816293 17239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:16.817364 17240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:16.821888 17236 heartbeater.cc:344] Connected to a master server at 127.13.194.126:42773
I20260201 08:59:16.822299 17236 heartbeater.cc:461] Registering TS with master...
W20260201 08:59:16.823194 17242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:16.823215 17236 heartbeater.cc:507] Master 127.13.194.126:42773 requested a full tablet report, sending...
I20260201 08:59:16.823974 14089 server_base.cc:1060] running on GCE node
I20260201 08:59:16.825996 16960 ts_manager.cc:194] Registered new tserver with Master: f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:16.826141 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:16.826432 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:16.826602 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936356826589 us; error 0 us; skew 500 ppm
I20260201 08:59:16.827135 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260201 08:59:16.827533 16960 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51064
I20260201 08:59:16.829806 14089 webserver.cc:492] Webserver started at http://127.13.194.68:36639/ using document root <none> and password file <none>
I20260201 08:59:16.830358 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:16.830540 14089 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 08:59:16.830786 14089 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 08:59:16.831893 14089 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-3-root/instance:
uuid: "f97c64e8acf34ae28a520dd40fc5281c"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.836500 14089 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260201 08:59:16.839756 17247 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.840487 14089 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260201 08:59:16.840811 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-3-root
uuid: "f97c64e8acf34ae28a520dd40fc5281c"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:16.841136 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 08:59:16.853295 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:16.854749 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 08:59:16.856598 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:16.859680 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 08:59:16.859953 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.860229 14089 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 08:59:16.860431 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:16.901161 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.68:45925
I20260201 08:59:16.901269 17309 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.68:45925 every 8 connection(s)
I20260201 08:59:16.914235 17310 heartbeater.cc:344] Connected to a master server at 127.13.194.126:42773
I20260201 08:59:16.914614 17310 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:16.915272 17310 heartbeater.cc:507] Master 127.13.194.126:42773 requested a full tablet report, sending...
I20260201 08:59:16.917222 16960 ts_manager.cc:194] Registered new tserver with Master: f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:16.918147 14089 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013814153s
I20260201 08:59:16.918812 16960 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51072
I20260201 08:59:16.943279 16960 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51074:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260201 08:59:17.179054 17052 tablet_service.cc:1505] Processing CreateTablet for tablet 3d4bbc7074224d289f38153d63a1c181 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260201 08:59:17.180641 17052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4bbc7074224d289f38153d63a1c181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.184618 17275 tablet_service.cc:1505] Processing CreateTablet for tablet 3d4bbc7074224d289f38153d63a1c181 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260201 08:59:17.186050 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4bbc7074224d289f38153d63a1c181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.186003 17051 tablet_service.cc:1505] Processing CreateTablet for tablet 2b8fb1d921544e74ad028b4471690420 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260201 08:59:17.187418 17051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b8fb1d921544e74ad028b4471690420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.198809 17201 tablet_service.cc:1505] Processing CreateTablet for tablet 2b8fb1d921544e74ad028b4471690420 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260201 08:59:17.200199 17201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b8fb1d921544e74ad028b4471690420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.203583 17200 tablet_service.cc:1505] Processing CreateTablet for tablet 9dd88f5c612b4e5985855eee079c4716 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260201 08:59:17.204967 17200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd88f5c612b4e5985855eee079c4716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.206902 17050 tablet_service.cc:1505] Processing CreateTablet for tablet 9dd88f5c612b4e5985855eee079c4716 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260201 08:59:17.208281 17050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd88f5c612b4e5985855eee079c4716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.208153 17274 tablet_service.cc:1505] Processing CreateTablet for tablet 9dd88f5c612b4e5985855eee079c4716 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260201 08:59:17.210670 17273 tablet_service.cc:1505] Processing CreateTablet for tablet c7a634ccefb24b158e97cff94318758f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260201 08:59:17.211975 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a634ccefb24b158e97cff94318758f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.214339 17049 tablet_service.cc:1505] Processing CreateTablet for tablet b057fd1bf2ef435ab6dcce60b1e45e10 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260201 08:59:17.215049 17272 tablet_service.cc:1505] Processing CreateTablet for tablet 4f1aa904185346f688e8877d1046ed2e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260201 08:59:17.215642 17049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b057fd1bf2ef435ab6dcce60b1e45e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.218294 17048 tablet_service.cc:1505] Processing CreateTablet for tablet 4f1aa904185346f688e8877d1046ed2e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260201 08:59:17.219570 17048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1aa904185346f688e8877d1046ed2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.221385 17271 tablet_service.cc:1505] Processing CreateTablet for tablet 08d6f47dbb384bb29b5d6f97211bcdfc (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260201 08:59:17.222743 17271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d6f47dbb384bb29b5d6f97211bcdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.226135 17046 tablet_service.cc:1505] Processing CreateTablet for tablet c3d3eb882b354a0089a1a129ce4be4c1 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260201 08:59:17.227454 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d3eb882b354a0089a1a129ce4be4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.229844 17270 tablet_service.cc:1505] Processing CreateTablet for tablet 633da6e0243e4ed295549ef2f930e78d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260201 08:59:17.222373 17047 tablet_service.cc:1505] Processing CreateTablet for tablet 08d6f47dbb384bb29b5d6f97211bcdfc (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260201 08:59:17.231722 17047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d6f47dbb384bb29b5d6f97211bcdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.232321 17269 tablet_service.cc:1505] Processing CreateTablet for tablet e6a0a5248f484893bbcb06eba6d364c7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260201 08:59:17.235424 17268 tablet_service.cc:1505] Processing CreateTablet for tablet da4eaf0bffdc44689593bcfe6cc4cbf1 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260201 08:59:17.238327 17045 tablet_service.cc:1505] Processing CreateTablet for tablet e6a0a5248f484893bbcb06eba6d364c7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260201 08:59:17.239625 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a0a5248f484893bbcb06eba6d364c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.240569 17267 tablet_service.cc:1505] Processing CreateTablet for tablet ce4e1322b3134c60b0641a8941a7f76e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260201 08:59:17.241931 17044 tablet_service.cc:1505] Processing CreateTablet for tablet da4eaf0bffdc44689593bcfe6cc4cbf1 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260201 08:59:17.243253 17044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4eaf0bffdc44689593bcfe6cc4cbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.246137 17043 tablet_service.cc:1505] Processing CreateTablet for tablet aec9b4feb0a8410c98176562346a7ca9 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260201 08:59:17.247485 17043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec9b4feb0a8410c98176562346a7ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.248747 17266 tablet_service.cc:1505] Processing CreateTablet for tablet d5f3df5d3bc344959e184b53bca122d4 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260201 08:59:17.226095 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd88f5c612b4e5985855eee079c4716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.250085 17266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3df5d3bc344959e184b53bca122d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.263459 17199 tablet_service.cc:1505] Processing CreateTablet for tablet c7a634ccefb24b158e97cff94318758f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260201 08:59:17.264914 17199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a634ccefb24b158e97cff94318758f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.269253 17270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633da6e0243e4ed295549ef2f930e78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.269245 17198 tablet_service.cc:1505] Processing CreateTablet for tablet b057fd1bf2ef435ab6dcce60b1e45e10 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260201 08:59:17.270758 17198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b057fd1bf2ef435ab6dcce60b1e45e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.273263 17269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a0a5248f484893bbcb06eba6d364c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.274154 17197 tablet_service.cc:1505] Processing CreateTablet for tablet 08d6f47dbb384bb29b5d6f97211bcdfc (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260201 08:59:17.275533 17197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08d6f47dbb384bb29b5d6f97211bcdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.276587 17267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4e1322b3134c60b0641a8941a7f76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.278666 17196 tablet_service.cc:1505] Processing CreateTablet for tablet 633da6e0243e4ed295549ef2f930e78d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260201 08:59:17.280052 17196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633da6e0243e4ed295549ef2f930e78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.281188 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4eaf0bffdc44689593bcfe6cc4cbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.284761 17195 tablet_service.cc:1505] Processing CreateTablet for tablet c3d3eb882b354a0089a1a129ce4be4c1 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260201 08:59:17.286202 17195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d3eb882b354a0089a1a129ce4be4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.285212 17272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1aa904185346f688e8877d1046ed2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.294689 17194 tablet_service.cc:1505] Processing CreateTablet for tablet da4eaf0bffdc44689593bcfe6cc4cbf1 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260201 08:59:17.296110 17194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4eaf0bffdc44689593bcfe6cc4cbf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.337042 17193 tablet_service.cc:1505] Processing CreateTablet for tablet ce4e1322b3134c60b0641a8941a7f76e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260201 08:59:17.338409 17193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4e1322b3134c60b0641a8941a7f76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.357316 17192 tablet_service.cc:1505] Processing CreateTablet for tablet aec9b4feb0a8410c98176562346a7ca9 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260201 08:59:17.358824 17192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec9b4feb0a8410c98176562346a7ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.352413 17046 tablet_service.cc:1505] Processing CreateTablet for tablet d5f3df5d3bc344959e184b53bca122d4 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260201 08:59:17.365656 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3df5d3bc344959e184b53bca122d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.373100 17127 tablet_service.cc:1505] Processing CreateTablet for tablet 3d4bbc7074224d289f38153d63a1c181 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260201 08:59:17.374485 17127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d4bbc7074224d289f38153d63a1c181. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.376850 17118 tablet_service.cc:1505] Processing CreateTablet for tablet aec9b4feb0a8410c98176562346a7ca9 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260201 08:59:17.378245 17118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec9b4feb0a8410c98176562346a7ca9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.377986 17051 tablet_service.cc:1505] Processing CreateTablet for tablet 01d3235b5e3846929a4eeb9edb554d85 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260201 08:59:17.379379 17051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d3235b5e3846929a4eeb9edb554d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.381963 17126 tablet_service.cc:1505] Processing CreateTablet for tablet 2b8fb1d921544e74ad028b4471690420 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260201 08:59:17.383294 17126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b8fb1d921544e74ad028b4471690420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.385993 17124 tablet_service.cc:1505] Processing CreateTablet for tablet b057fd1bf2ef435ab6dcce60b1e45e10 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260201 08:59:17.387300 17124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b057fd1bf2ef435ab6dcce60b1e45e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.389904 17122 tablet_service.cc:1505] Processing CreateTablet for tablet 633da6e0243e4ed295549ef2f930e78d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260201 08:59:17.391207 17122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 633da6e0243e4ed295549ef2f930e78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.381873 17125 tablet_service.cc:1505] Processing CreateTablet for tablet c7a634ccefb24b158e97cff94318758f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260201 08:59:17.398917 17120 tablet_service.cc:1505] Processing CreateTablet for tablet e6a0a5248f484893bbcb06eba6d364c7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260201 08:59:17.405984 17119 tablet_service.cc:1505] Processing CreateTablet for tablet ce4e1322b3134c60b0641a8941a7f76e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260201 08:59:17.408120 17123 tablet_service.cc:1505] Processing CreateTablet for tablet 4f1aa904185346f688e8877d1046ed2e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260201 08:59:17.410197 17121 tablet_service.cc:1505] Processing CreateTablet for tablet c3d3eb882b354a0089a1a129ce4be4c1 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260201 08:59:17.412549 17125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a634ccefb24b158e97cff94318758f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.413812 17271 tablet_service.cc:1505] Processing CreateTablet for tablet 71cc0a70e15b4a16b50124dc47a046cd (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260201 08:59:17.415108 17271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cc0a70e15b4a16b50124dc47a046cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.424057 17327 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:17.393435 17273 tablet_service.cc:1505] Processing CreateTablet for tablet 01d3235b5e3846929a4eeb9edb554d85 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260201 08:59:17.424700 17275 tablet_service.cc:1505] Processing CreateTablet for tablet 5713f7a57fd74d28b4576c047864054f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260201 08:59:17.425344 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d3235b5e3846929a4eeb9edb554d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.426087 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5713f7a57fd74d28b4576c047864054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.430387 17327 tablet_bootstrap.cc:654] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:17.432933 17266 tablet_service.cc:1505] Processing CreateTablet for tablet 8756377c82b244dba54033faa382e693 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260201 08:59:17.454411 17120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6a0a5248f484893bbcb06eba6d364c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.459003 17200 tablet_service.cc:1505] Processing CreateTablet for tablet 23892c545fda4a0ba2e3d29d32230ba3 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260201 08:59:17.458935 17123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1aa904185346f688e8877d1046ed2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.460302 17200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23892c545fda4a0ba2e3d29d32230ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.463574 17119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4e1322b3134c60b0641a8941a7f76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.468465 17121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3d3eb882b354a0089a1a129ce4be4c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.473441 17199 tablet_service.cc:1505] Processing CreateTablet for tablet 73e3e5cdfd85463abd7eeb4fe5b87c77 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260201 08:59:17.472002 17046 tablet_service.cc:1505] Processing CreateTablet for tablet 8756377c82b244dba54033faa382e693 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260201 08:59:17.473347 17045 tablet_service.cc:1505] Processing CreateTablet for tablet 23892c545fda4a0ba2e3d29d32230ba3 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260201 08:59:17.479717 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23892c545fda4a0ba2e3d29d32230ba3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:59:17.476981 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:17.489682 17196 tablet_service.cc:1505] Processing CreateTablet for tablet 01d3235b5e3846929a4eeb9edb554d85 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260201 08:59:17.489809 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8756377c82b244dba54033faa382e693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.490993 17266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8756377c82b244dba54033faa382e693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.496559 17044 tablet_service.cc:1505] Processing CreateTablet for tablet b713edafee9f47fcaeed41159ac7e30d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260201 08:59:17.497536 17329 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:17.498016 17044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b713edafee9f47fcaeed41159ac7e30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.501470 17198 tablet_service.cc:1505] Processing CreateTablet for tablet 71cc0a70e15b4a16b50124dc47a046cd (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260201 08:59:17.501474 17199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e3e5cdfd85463abd7eeb4fe5b87c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.505419 17328 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:17.509220 17196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d3235b5e3846929a4eeb9edb554d85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.509641 17194 tablet_service.cc:1505] Processing CreateTablet for tablet 8756377c82b244dba54033faa382e693 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260201 08:59:17.510949 17194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8756377c82b244dba54033faa382e693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.513199 17198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cc0a70e15b4a16b50124dc47a046cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.514670 17192 tablet_service.cc:1505] Processing CreateTablet for tablet b713edafee9f47fcaeed41159ac7e30d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260201 08:59:17.516037 17192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b713edafee9f47fcaeed41159ac7e30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.520129 17193 tablet_service.cc:1505] Processing CreateTablet for tablet d454a89732b54703b564e1c647bbb335 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260201 08:59:17.526214 17052 tablet_service.cc:1505] Processing CreateTablet for tablet d454a89732b54703b564e1c647bbb335 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260201 08:59:17.521826 17045 tablet_service.cc:1505] Processing CreateTablet for tablet c6883c591b5547018eba339947c179ce (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260201 08:59:17.527539 17052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d454a89732b54703b564e1c647bbb335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.528453 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6883c591b5547018eba339947c179ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.529814 17329 tablet_bootstrap.cc:654] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:17.535284 17124 tablet_service.cc:1505] Processing CreateTablet for tablet 71cc0a70e15b4a16b50124dc47a046cd (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260201 08:59:17.536598 17124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cc0a70e15b4a16b50124dc47a046cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.545960 17120 tablet_service.cc:1505] Processing CreateTablet for tablet d5f3df5d3bc344959e184b53bca122d4 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260201 08:59:17.546959 17046 tablet_service.cc:1505] Processing CreateTablet for tablet fe438a8cca4545538587c8be3489cf00 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260201 08:59:17.549762 17201 tablet_service.cc:1505] Processing CreateTablet for tablet 8f36c29f280a42faa270584136681eda (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260201 08:59:17.550011 17119 tablet_service.cc:1505] Processing CreateTablet for tablet 23892c545fda4a0ba2e3d29d32230ba3 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260201 08:59:17.551386 17119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23892c545fda4a0ba2e3d29d32230ba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.559540 17332 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:17.568583 17270 tablet_service.cc:1505] Processing CreateTablet for tablet c6883c591b5547018eba339947c179ce (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260201 08:59:17.570014 17270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6883c591b5547018eba339947c179ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.569803 17268 tablet_service.cc:1505] Processing CreateTablet for tablet d454a89732b54703b564e1c647bbb335 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260201 08:59:17.571225 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d454a89732b54703b564e1c647bbb335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.577117 17267 tablet_service.cc:1505] Processing CreateTablet for tablet 8f36c29f280a42faa270584136681eda (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260201 08:59:17.578423 17267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f36c29f280a42faa270584136681eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.580713 17275 tablet_service.cc:1505] Processing CreateTablet for tablet 73e3e5cdfd85463abd7eeb4fe5b87c77 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260201 08:59:17.582055 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e3e5cdfd85463abd7eeb4fe5b87c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.591853 17268 tablet_service.cc:1505] Processing CreateTablet for tablet 19c509ac348a4d5b8b4a9760fa30c652 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260201 08:59:17.593398 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c509ac348a4d5b8b4a9760fa30c652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.596012 17197 tablet_service.cc:1505] Processing CreateTablet for tablet 7f2feb4eecaf434f8a756b3934813632 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260201 08:59:17.599470 17043 tablet_service.cc:1505] Processing CreateTablet for tablet 19c509ac348a4d5b8b4a9760fa30c652 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260201 08:59:17.599988 17269 tablet_service.cc:1505] Processing CreateTablet for tablet 7f2feb4eecaf434f8a756b3934813632 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260201 08:59:17.612030 17047 tablet_service.cc:1505] Processing CreateTablet for tablet 7f2feb4eecaf434f8a756b3934813632 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260201 08:59:17.612802 17268 tablet_service.cc:1505] Processing CreateTablet for tablet 419daee934394566a5c13ed9d478cb25 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260201 08:59:17.615185 17327 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:17.615840 17327 ts_tablet_manager.cc:1403] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.192s user 0.009s sys 0.026s
I20260201 08:59:17.618811 17327 raft_consensus.cc:359] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:17.619555 17327 raft_consensus.cc:385] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:17.619856 17327 raft_consensus.cc:740] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:17.621198 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe438a8cca4545538587c8be3489cf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.622202 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419daee934394566a5c13ed9d478cb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.624950 17120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5f3df5d3bc344959e184b53bca122d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.629851 17328 tablet_bootstrap.cc:654] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:17.620754 17327 consensus_queue.cc:260] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:17.641409 17201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f36c29f280a42faa270584136681eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.468505 17050 tablet_service.cc:1505] Processing CreateTablet for tablet 5713f7a57fd74d28b4576c047864054f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260201 08:59:17.650712 17043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c509ac348a4d5b8b4a9760fa30c652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.654845 17269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2feb4eecaf434f8a756b3934813632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.662354 17087 heartbeater.cc:499] Master 127.13.194.126:42773 was elected leader, sending a full tablet report...
I20260201 08:59:17.663509 17193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d454a89732b54703b564e1c647bbb335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.669348 17125 tablet_service.cc:1505] Processing CreateTablet for tablet b713edafee9f47fcaeed41159ac7e30d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260201 08:59:17.670106 17121 tablet_service.cc:1505] Processing CreateTablet for tablet 73e3e5cdfd85463abd7eeb4fe5b87c77 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260201 08:59:17.670492 17047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2feb4eecaf434f8a756b3934813632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.671438 17121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73e3e5cdfd85463abd7eeb4fe5b87c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.674396 17125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b713edafee9f47fcaeed41159ac7e30d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.669272 17195 tablet_service.cc:1505] Processing CreateTablet for tablet fe438a8cca4545538587c8be3489cf00 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260201 08:59:17.685956 17198 tablet_service.cc:1505] Processing CreateTablet for tablet 419daee934394566a5c13ed9d478cb25 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260201 08:59:17.657835 17123 tablet_service.cc:1505] Processing CreateTablet for tablet 5713f7a57fd74d28b4576c047864054f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260201 08:59:17.687381 17050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5713f7a57fd74d28b4576c047864054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.688084 17123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5713f7a57fd74d28b4576c047864054f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.691761 17272 tablet_service.cc:1505] Processing CreateTablet for tablet fe590c5ab6064559bcc7599baa5667c5 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260201 08:59:17.693120 17272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe590c5ab6064559bcc7599baa5667c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.676075 17126 tablet_service.cc:1505] Processing CreateTablet for tablet c6883c591b5547018eba339947c179ce (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260201 08:59:17.697660 17329 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:17.698650 17329 ts_tablet_manager.cc:1403] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.201s user 0.066s sys 0.028s
I20260201 08:59:17.707711 17329 raft_consensus.cc:359] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:17.714450 17118 tablet_service.cc:1505] Processing CreateTablet for tablet 8f36c29f280a42faa270584136681eda (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260201 08:59:17.716809 17048 tablet_service.cc:1505] Processing CreateTablet for tablet fe590c5ab6064559bcc7599baa5667c5 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260201 08:59:17.719928 17048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe590c5ab6064559bcc7599baa5667c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.725726 17127 tablet_service.cc:1505] Processing CreateTablet for tablet fe438a8cca4545538587c8be3489cf00 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260201 08:59:17.726639 17329 raft_consensus.cc:385] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:17.696753 17126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6883c591b5547018eba339947c179ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.736958 17200 tablet_service.cc:1505] Processing CreateTablet for tablet a3beb95bbbb64b4485bc29a00f4c7854 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260201 08:59:17.727419 17197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2feb4eecaf434f8a756b3934813632. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.740289 17332 tablet_bootstrap.cc:654] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:17.735294 17045 tablet_service.cc:1505] Processing CreateTablet for tablet 95c8a318ae314c74b860cee66450033c (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260201 08:59:17.742892 17051 tablet_service.cc:1505] Processing CreateTablet for tablet a3beb95bbbb64b4485bc29a00f4c7854 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260201 08:59:17.744002 17162 heartbeater.cc:499] Master 127.13.194.126:42773 was elected leader, sending a full tablet report...
I20260201 08:59:17.752986 17329 raft_consensus.cc:740] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:17.754256 17329 consensus_queue.cc:260] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:17.762101 17271 tablet_service.cc:1505] Processing CreateTablet for tablet ec25fe85ebfe48158cd273ded375fd96 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260201 08:59:17.763628 17271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec25fe85ebfe48158cd273ded375fd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.771226 17122 tablet_service.cc:1505] Processing CreateTablet for tablet 19c509ac348a4d5b8b4a9760fa30c652 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260201 08:59:17.772593 17122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19c509ac348a4d5b8b4a9760fa30c652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.772401 17274 tablet_service.cc:1505] Processing CreateTablet for tablet b58ae14986de4b32bbd4ae3d2b530783 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260201 08:59:17.773910 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58ae14986de4b32bbd4ae3d2b530783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.778940 17273 tablet_service.cc:1505] Processing CreateTablet for tablet 6af74496ca1949d78f5a2a08f5cb9635 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260201 08:59:17.780251 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af74496ca1949d78f5a2a08f5cb9635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.783324 17199 tablet_service.cc:1505] Processing CreateTablet for tablet 95c8a318ae314c74b860cee66450033c (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260201 08:59:17.784608 17199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c8a318ae314c74b860cee66450033c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.787830 17266 tablet_service.cc:1505] Processing CreateTablet for tablet 5d3dae430c6f4b21a70c4dd16b3dd446 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260201 08:59:17.789155 17266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3dae430c6f4b21a70c4dd16b3dd446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.809662 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c8a318ae314c74b860cee66450033c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.818357 17327 ts_tablet_manager.cc:1434] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.202s user 0.050s sys 0.074s
I20260201 08:59:17.819067 17328 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:17.815119 17118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f36c29f280a42faa270584136681eda. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:59:17.822486 16944 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 78491.2us
I20260201 08:59:17.829234 17125 tablet_service.cc:1505] Processing CreateTablet for tablet 419daee934394566a5c13ed9d478cb25 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260201 08:59:17.830273 17236 heartbeater.cc:499] Master 127.13.194.126:42773 was elected leader, sending a full tablet report...
I20260201 08:59:17.833439 17194 tablet_service.cc:1505] Processing CreateTablet for tablet 646f532b2c434b56b4efba4e815711a7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260201 08:59:17.834632 17196 tablet_service.cc:1505] Processing CreateTablet for tablet ec25fe85ebfe48158cd273ded375fd96 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260201 08:59:17.835750 17051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3beb95bbbb64b4485bc29a00f4c7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.815393 17198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419daee934394566a5c13ed9d478cb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.848966 17268 tablet_service.cc:1505] Processing CreateTablet for tablet 95c8a318ae314c74b860cee66450033c (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260201 08:59:17.836720 17049 tablet_service.cc:1505] Processing CreateTablet for tablet 646f532b2c434b56b4efba4e815711a7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260201 08:59:17.878844 17328 ts_tablet_manager.cc:1403] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.374s user 0.006s sys 0.016s
I20260201 08:59:17.880203 17329 ts_tablet_manager.cc:1434] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.175s user 0.031s sys 0.031s
I20260201 08:59:17.881152 17327 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:17.847863 17046 tablet_service.cc:1505] Processing CreateTablet for tablet b58ae14986de4b32bbd4ae3d2b530783 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260201 08:59:17.906930 17329 tablet_bootstrap.cc:492] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:17.910434 17328 raft_consensus.cc:359] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:17.911226 17328 raft_consensus.cc:385] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:17.884852 17275 tablet_service.cc:1505] Processing CreateTablet for tablet e2d7b23e195941c5a5d351fc04a2a64d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260201 08:59:17.890115 17127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe438a8cca4545538587c8be3489cf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.884742 17269 tablet_service.cc:1505] Processing CreateTablet for tablet 457eeb0a14cc4d28823521cfef13996e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260201 08:59:17.894721 17088 tablet.cc:2378] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260201 08:59:17.933386 17125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419daee934394566a5c13ed9d478cb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.917387 17049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 646f532b2c434b56b4efba4e815711a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.935022 17267 tablet_service.cc:1505] Processing CreateTablet for tablet 76831f67d1c74e10a89a36c2fed5f81f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260201 08:59:17.918574 17328 raft_consensus.cc:740] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:17.921126 17194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 646f532b2c434b56b4efba4e815711a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.921734 17310 heartbeater.cc:499] Master 127.13.194.126:42773 was elected leader, sending a full tablet report...
I20260201 08:59:17.936831 17328 consensus_queue.cc:260] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:17.948071 17044 tablet_service.cc:1505] Processing CreateTablet for tablet 5373f77eaf6a488faf35417ffdaa32b3 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260201 08:59:17.938220 17196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec25fe85ebfe48158cd273ded375fd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.949717 17195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe438a8cca4545538587c8be3489cf00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.941210 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58ae14986de4b32bbd4ae3d2b530783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.937932 17332 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:17.953464 17332 ts_tablet_manager.cc:1403] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.394s user 0.012s sys 0.006s
I20260201 08:59:17.957183 17200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3beb95bbbb64b4485bc29a00f4c7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.925024 17192 tablet_service.cc:1505] Processing CreateTablet for tablet 5d3dae430c6f4b21a70c4dd16b3dd446 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260201 08:59:17.959473 17192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3dae430c6f4b21a70c4dd16b3dd446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.929379 17327 tablet_bootstrap.cc:654] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:17.929054 17126 tablet_service.cc:1505] Processing CreateTablet for tablet fe590c5ab6064559bcc7599baa5667c5 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260201 08:59:17.964107 17126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe590c5ab6064559bcc7599baa5667c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.911338 17193 tablet_service.cc:1505] Processing CreateTablet for tablet 6af74496ca1949d78f5a2a08f5cb9635 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260201 08:59:17.942873 17123 tablet_service.cc:1505] Processing CreateTablet for tablet 646f532b2c434b56b4efba4e815711a7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260201 08:59:17.965896 17193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af74496ca1949d78f5a2a08f5cb9635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.966362 17123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 646f532b2c434b56b4efba4e815711a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.929831 17119 tablet_service.cc:1505] Processing CreateTablet for tablet a3beb95bbbb64b4485bc29a00f4c7854 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260201 08:59:17.932479 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c8a318ae314c74b860cee66450033c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.968497 17119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3beb95bbbb64b4485bc29a00f4c7854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.969157 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d7b23e195941c5a5d351fc04a2a64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.969797 17269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457eeb0a14cc4d28823521cfef13996e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.970441 17267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76831f67d1c74e10a89a36c2fed5f81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.934942 17124 tablet_service.cc:1505] Processing CreateTablet for tablet ec25fe85ebfe48158cd273ded375fd96 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260201 08:59:17.973820 17124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec25fe85ebfe48158cd273ded375fd96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.981431 17052 tablet_service.cc:1505] Processing CreateTablet for tablet 6af74496ca1949d78f5a2a08f5cb9635 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260201 08:59:17.981985 17120 tablet_service.cc:1505] Processing CreateTablet for tablet b58ae14986de4b32bbd4ae3d2b530783 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260201 08:59:17.983446 17120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58ae14986de4b32bbd4ae3d2b530783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.987067 17044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5373f77eaf6a488faf35417ffdaa32b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:17.989971 17047 tablet_service.cc:1505] Processing CreateTablet for tablet e2d7b23e195941c5a5d351fc04a2a64d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260201 08:59:17.993534 17329 tablet_bootstrap.cc:654] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:17.995333 17332 raft_consensus.cc:359] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.001302 17272 tablet_service.cc:1505] Processing CreateTablet for tablet f4d85af3240d4e3b858634e83c48c93e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260201 08:59:18.004941 17271 tablet_service.cc:1505] Processing CreateTablet for tablet a4fc35bc514f47bc8de1d20b274d3416 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260201 08:59:18.009981 17197 tablet_service.cc:1505] Processing CreateTablet for tablet 5373f77eaf6a488faf35417ffdaa32b3 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260201 08:59:18.019078 17048 tablet_service.cc:1505] Processing CreateTablet for tablet 457eeb0a14cc4d28823521cfef13996e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260201 08:59:18.026880 17327 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:18.027316 17266 tablet_service.cc:1505] Processing CreateTablet for tablet f6c4831e95cb49de81c217e813d2a06d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260201 08:59:18.037729 17327 ts_tablet_manager.cc:1403] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.157s user 0.011s sys 0.000s
I20260201 08:59:18.042220 17043 tablet_service.cc:1505] Processing CreateTablet for tablet ea425e459b1e4b09b34817d64cea28e7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260201 08:59:18.040614 17327 raft_consensus.cc:359] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.044093 17327 raft_consensus.cc:385] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.044405 17327 raft_consensus.cc:740] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.045645 17052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6af74496ca1949d78f5a2a08f5cb9635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.046067 17050 tablet_service.cc:1505] Processing CreateTablet for tablet f4d85af3240d4e3b858634e83c48c93e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260201 08:59:18.047281 17050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d85af3240d4e3b858634e83c48c93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.050287 17045 tablet_service.cc:1505] Processing CreateTablet for tablet a4fc35bc514f47bc8de1d20b274d3416 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260201 08:59:18.051512 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fc35bc514f47bc8de1d20b274d3416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.053990 17043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea425e459b1e4b09b34817d64cea28e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.061476 17197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5373f77eaf6a488faf35417ffdaa32b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.064304 17047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d7b23e195941c5a5d351fc04a2a64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.069886 17118 tablet_service.cc:1505] Processing CreateTablet for tablet 5d3dae430c6f4b21a70c4dd16b3dd446 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260201 08:59:18.071209 17118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3dae430c6f4b21a70c4dd16b3dd446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.073021 17048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457eeb0a14cc4d28823521cfef13996e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.076953 17327 consensus_queue.cc:260] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.079260 17327 ts_tablet_manager.cc:1434] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260201 08:59:18.080194 17327 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:18.086109 17328 ts_tablet_manager.cc:1434] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.182s user 0.006s sys 0.005s
I20260201 08:59:18.087347 17121 tablet_service.cc:1505] Processing CreateTablet for tablet 5373f77eaf6a488faf35417ffdaa32b3 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260201 08:59:18.089363 17127 tablet_service.cc:1505] Processing CreateTablet for tablet e2d7b23e195941c5a5d351fc04a2a64d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260201 08:59:18.090690 17049 tablet_service.cc:1505] Processing CreateTablet for tablet 2c3c8e7e03764c049810ad470ab313c7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260201 08:59:18.130336 17049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3c8e7e03764c049810ad470ab313c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.134613 17201 tablet_service.cc:1505] Processing CreateTablet for tablet a4fc35bc514f47bc8de1d20b274d3416 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260201 08:59:18.029846 17332 raft_consensus.cc:385] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.135980 17332 raft_consensus.cc:740] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.102797 17270 tablet_service.cc:1505] Processing CreateTablet for tablet 10f95c4a674b4c4a8df3ea0869c9b4da (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260201 08:59:18.102780 17194 tablet_service.cc:1505] Processing CreateTablet for tablet 457eeb0a14cc4d28823521cfef13996e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260201 08:59:18.104924 17274 tablet_service.cc:1505] Processing CreateTablet for tablet 68c080f2c06d4219bdb2e4a546153bc4 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260201 08:59:18.089363 17121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5373f77eaf6a488faf35417ffdaa32b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.106698 17192 tablet_service.cc:1505] Processing CreateTablet for tablet 76831f67d1c74e10a89a36c2fed5f81f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260201 08:59:18.110865 17334 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.142407 17334 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.143712 17126 tablet_service.cc:1505] Processing CreateTablet for tablet f4d85af3240d4e3b858634e83c48c93e (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260201 08:59:18.145071 17126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d85af3240d4e3b858634e83c48c93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.122875 17329 tablet_bootstrap.cc:492] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:18.146472 17201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fc35bc514f47bc8de1d20b274d3416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.150079 17329 ts_tablet_manager.cc:1403] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.243s user 0.018s sys 0.000s
I20260201 08:59:18.153604 17192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76831f67d1c74e10a89a36c2fed5f81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.155647 17335 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.125082 17124 tablet_service.cc:1505] Processing CreateTablet for tablet 76831f67d1c74e10a89a36c2fed5f81f (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260201 08:59:18.128952 17269 tablet_service.cc:1505] Processing CreateTablet for tablet 9bad6ae52daf4b8bba5e450dbee00fe0 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260201 08:59:18.135273 17198 tablet_service.cc:1505] Processing CreateTablet for tablet f6c4831e95cb49de81c217e813d2a06d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260201 08:59:18.094791 17271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fc35bc514f47bc8de1d20b274d3416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.147045 17334 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:18.171968 17270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f95c4a674b4c4a8df3ea0869c9b4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.172269 17334 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.172734 17334 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.173753 17046 tablet_service.cc:1505] Processing CreateTablet for tablet 68c080f2c06d4219bdb2e4a546153bc4 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260201 08:59:18.175038 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c080f2c06d4219bdb2e4a546153bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.156183 17335 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.181003 17335 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:18.174924 17334 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:18.188743 17328 tablet_bootstrap.cc:492] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:18.189150 17273 tablet_service.cc:1505] Processing CreateTablet for tablet 2c4343ae3470408987d247c06337e0a5 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260201 08:59:18.189555 17272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d85af3240d4e3b858634e83c48c93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.177654 17194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 457eeb0a14cc4d28823521cfef13996e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.157027 17199 tablet_service.cc:1505] Processing CreateTablet for tablet ea425e459b1e4b09b34817d64cea28e7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260201 08:59:18.177937 17127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2d7b23e195941c5a5d351fc04a2a64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.135847 17122 tablet_service.cc:1505] Processing CreateTablet for tablet ea425e459b1e4b09b34817d64cea28e7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260201 08:59:18.211712 17268 tablet_service.cc:1505] Processing CreateTablet for tablet 22ea6a68454747bf8c2fb8b0af084d3a (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260201 08:59:18.214699 17120 tablet_service.cc:1505] Processing CreateTablet for tablet 2c3c8e7e03764c049810ad470ab313c7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260201 08:59:18.222280 17198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c4831e95cb49de81c217e813d2a06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.178023 17329 raft_consensus.cc:359] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.229424 17329 raft_consensus.cc:385] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.229825 17329 raft_consensus.cc:740] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.230589 17329 consensus_queue.cc:260] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.135988 17051 tablet_service.cc:1505] Processing CreateTablet for tablet 10f95c4a674b4c4a8df3ea0869c9b4da (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260201 08:59:18.242130 17327 tablet_bootstrap.cc:654] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.248225 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c080f2c06d4219bdb2e4a546153bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.180840 17119 tablet_service.cc:1505] Processing CreateTablet for tablet f6c4831e95cb49de81c217e813d2a06d (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260201 08:59:18.234220 17044 tablet_service.cc:1505] Processing CreateTablet for tablet ef3dae7e71e447b79f434ce7b1684707 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260201 08:59:18.265759 17329 ts_tablet_manager.cc:1434] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.115s user 0.009s sys 0.000s
I20260201 08:59:18.265408 17122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea425e459b1e4b09b34817d64cea28e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.192436 17332 consensus_queue.cc:260] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.306507 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ea6a68454747bf8c2fb8b0af084d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.306857 17051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f95c4a674b4c4a8df3ea0869c9b4da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.318850 17124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76831f67d1c74e10a89a36c2fed5f81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.325315 17196 tablet_service.cc:1505] Processing CreateTablet for tablet 68c080f2c06d4219bdb2e4a546153bc4 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260201 08:59:18.325320 17195 tablet_service.cc:1505] Processing CreateTablet for tablet 2c3c8e7e03764c049810ad470ab313c7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260201 08:59:18.327714 17199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea425e459b1e4b09b34817d64cea28e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.328120 17329 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:18.316602 17335 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.390271 17195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3c8e7e03764c049810ad470ab313c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.353593 17125 tablet_service.cc:1505] Processing CreateTablet for tablet 9bad6ae52daf4b8bba5e450dbee00fe0 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260201 08:59:18.358780 17193 tablet_service.cc:1505] Processing CreateTablet for tablet ef3dae7e71e447b79f434ce7b1684707 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260201 08:59:18.359423 17050 tablet_service.cc:1505] Processing CreateTablet for tablet 2c4343ae3470408987d247c06337e0a5 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260201 08:59:18.360999 17047 tablet_service.cc:1505] Processing CreateTablet for tablet 22ea6a68454747bf8c2fb8b0af084d3a (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260201 08:59:18.366804 17197 tablet_service.cc:1505] Processing CreateTablet for tablet 22ea6a68454747bf8c2fb8b0af084d3a (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260201 08:59:18.367681 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:18.369251 17273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4343ae3470408987d247c06337e0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.376097 17043 tablet_service.cc:1505] Processing CreateTablet for tablet a5c32dbf875b45d7944fd036d09edc64 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260201 08:59:18.376264 17052 tablet_service.cc:1505] Processing CreateTablet for tablet dc19ac6347fa40b7b6d2c6912c975575 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260201 08:59:18.376996 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:18.381186 17044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3dae7e71e447b79f434ce7b1684707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.384400 17049 tablet_service.cc:1505] Processing CreateTablet for tablet 85f87e31da9e48ee853c4246adc1a1a2 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260201 08:59:18.329710 17200 tablet_service.cc:1505] Processing CreateTablet for tablet 9bad6ae52daf4b8bba5e450dbee00fe0 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260201 08:59:18.390314 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:18.392356 17335 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.402201 17196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68c080f2c06d4219bdb2e4a546153bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.398286 17118 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46068 (request call id 26) took 1016 ms. Trace:
I20260201 08:59:18.404676 17119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c4831e95cb49de81c217e813d2a06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.396679 17123 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46068 (request call id 24) took 1015 ms. Trace:
W20260201 08:59:18.413374 17174 leader_election.cc:343] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.413234 17123 rpcz_store.cc:276] 0201 08:59:17.380340 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:17.941968 (+561628us) service_pool.cc:225] Handling call
0201 08:59:17.965901 (+ 23933us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:17.966010 (+ 109us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.085575 (+119565us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.270933 (+185358us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.395403 (+124470us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260201 08:59:18.414523 17175 leader_election.cc:343] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.415074 17269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bad6ae52daf4b8bba5e450dbee00fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.414947 17175 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:18.415445 17123 tablet_service.cc:1505] Processing CreateTablet for tablet 10f95c4a674b4c4a8df3ea0869c9b4da (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260201 08:59:18.404675 17337 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.422144 17337 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.427403 17337 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:18.429322 17332 ts_tablet_manager.cc:1434] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.476s user 0.010s sys 0.005s
I20260201 08:59:18.430402 17332 tablet_bootstrap.cc:492] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:18.438292 17271 tablet_service.cc:1505] Processing CreateTablet for tablet a5c32dbf875b45d7944fd036d09edc64 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260201 08:59:18.440033 17267 tablet_service.cc:1505] Processing CreateTablet for tablet 85f87e31da9e48ee853c4246adc1a1a2 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260201 08:59:18.441581 17335 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:18.442137 17335 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:18.399711 17275 tablet_service.cc:1505] Processing CreateTablet for tablet de4970dd965f43208c799dedd555e5dc (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260201 08:59:18.448246 17266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6c4831e95cb49de81c217e813d2a06d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.450132 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:18.450591 17271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c32dbf875b45d7944fd036d09edc64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:59:18.451682 17025 leader_election.cc:343] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.453025 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:18.438213 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:18.454430 17174 leader_election.cc:343] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:18.455113 17025 leader_election.cc:343] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.447822 17197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ea6a68454747bf8c2fb8b0af084d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.457850 17327 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:18.458518 17327 ts_tablet_manager.cc:1403] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.379s user 0.012s sys 0.006s
I20260201 08:59:18.460402 17200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bad6ae52daf4b8bba5e450dbee00fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.461567 17327 raft_consensus.cc:359] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.467532 17121 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46068 (request call id 27) took 1021 ms. Trace:
I20260201 08:59:18.472736 17047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22ea6a68454747bf8c2fb8b0af084d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.483166 17329 tablet_bootstrap.cc:654] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.411376 17118 rpcz_store.cc:276] 0201 08:59:17.396135 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.069010 (+672875us) service_pool.cc:225] Handling call
0201 08:59:18.070756 (+ 1746us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.070856 (+ 100us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.226137 (+155281us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.344832 (+118695us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.397401 (+ 52569us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.478386 17123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10f95c4a674b4c4a8df3ea0869c9b4da. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:59:18.492224 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:18.492605 17043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c32dbf875b45d7944fd036d09edc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.500952 17267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f87e31da9e48ee853c4246adc1a1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.503176 17195 tablet_service.cc:1505] Processing CreateTablet for tablet de4970dd965f43208c799dedd555e5dc (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260201 08:59:18.506105 17196 tablet_service.cc:1505] Processing CreateTablet for tablet dc19ac6347fa40b7b6d2c6912c975575 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260201 08:59:18.521790 17048 tablet_service.cc:1505] Processing CreateTablet for tablet e4061439a0974c4d87b3541e46a95fc7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260201 08:59:18.521960 17200 tablet_service.cc:1505] Processing CreateTablet for tablet 85f87e31da9e48ee853c4246adc1a1a2 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260201 08:59:18.523200 17048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4061439a0974c4d87b3541e46a95fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.525990 17118 tablet_service.cc:1505] Processing CreateTablet for tablet ef3dae7e71e447b79f434ce7b1684707 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260201 08:59:18.527608 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:18.529135 17028 leader_election.cc:343] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.529577 17028 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:18.529724 17268 tablet_service.cc:1505] Processing CreateTablet for tablet 927294866f7f46cb8fa5ddd1ad31b2a9 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260201 08:59:18.530840 17343 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:18.536209 17126 tablet_service.cc:1505] Processing CreateTablet for tablet 2c4343ae3470408987d247c06337e0a5 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260201 08:59:18.477461 17327 raft_consensus.cc:385] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260201 08:59:18.487943 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 72094.7us
I20260201 08:59:18.540190 17048 tablet_service.cc:1505] Processing CreateTablet for tablet 927294866f7f46cb8fa5ddd1ad31b2a9 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260201 08:59:18.541790 17274 tablet_service.cc:1505] Processing CreateTablet for tablet c35836a4583949f3b2ac7cbef2205db2 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260201 08:59:18.542259 17197 tablet_service.cc:1505] Processing CreateTablet for tablet c35836a4583949f3b2ac7cbef2205db2 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260201 08:59:18.544582 17268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927294866f7f46cb8fa5ddd1ad31b2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.507927 17193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3dae7e71e447b79f434ce7b1684707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.551565 17049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f87e31da9e48ee853c4246adc1a1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.547184 17327 raft_consensus.cc:740] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.573335 17052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc19ac6347fa40b7b6d2c6912c975575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.573153 17327 consensus_queue.cc:260] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.574304 17352 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.574785 17352 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.575418 17327 ts_tablet_manager.cc:1434] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.117s user 0.005s sys 0.000s
I20260201 08:59:18.578548 17327 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:18.579909 17192 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45864 (request call id 29) took 1054 ms. Trace:
I20260201 08:59:18.580972 17192 rpcz_store.cc:276] 0201 08:59:17.525654 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.105855 (+580201us) service_pool.cc:225] Handling call
0201 08:59:18.153152 (+ 47297us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.153250 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.372116 (+218866us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.571999 (+199883us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.579744 (+ 7745us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.552668 17120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c3c8e7e03764c049810ad470ab313c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.559794 17045 tablet_service.cc:1505] Processing CreateTablet for tablet 08be66650c334ab1b9d801bb366c9969 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260201 08:59:18.587013 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08be66650c334ab1b9d801bb366c9969. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:59:18.552100 17027 leader_election.cc:343] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.587718 17027 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:18.587932 17194 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45864 (request call id 28) took 1080 ms. Trace:
I20260201 08:59:18.589011 17343 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:18.589968 17125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bad6ae52daf4b8bba5e450dbee00fe0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.591480 17118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef3dae7e71e447b79f434ce7b1684707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.591832 17272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54608 (request call id 30) took 1025 ms. Trace:
I20260201 08:59:18.591447 17048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927294866f7f46cb8fa5ddd1ad31b2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.593693 17198 tablet_service.cc:1505] Processing CreateTablet for tablet 08be66650c334ab1b9d801bb366c9969 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260201 08:59:18.597225 17050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4343ae3470408987d247c06337e0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.598497 17270 tablet_service.cc:1505] Processing CreateTablet for tablet 08be66650c334ab1b9d801bb366c9969 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260201 08:59:18.601126 17195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4970dd965f43208c799dedd555e5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.601785 17200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f87e31da9e48ee853c4246adc1a1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.602439 17196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc19ac6347fa40b7b6d2c6912c975575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.605015 17197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35836a4583949f3b2ac7cbef2205db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.550096 17328 tablet_bootstrap.cc:654] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.588310 17194 rpcz_store.cc:276] 0201 08:59:17.507589 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.101821 (+594232us) service_pool.cc:225] Handling call
0201 08:59:18.137255 (+ 35434us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.137345 (+ 90us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.349952 (+212607us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.587414 (+237462us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.587866 (+ 452us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.592275 17272 rpcz_store.cc:276] 0201 08:59:17.566748 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.000387 (+433639us) service_pool.cc:225] Handling call
0201 08:59:18.164989 (+164602us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.171711 (+ 6722us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.381289 (+209578us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.591310 (+210021us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.591773 (+ 463us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.543776 17122 tablet_service.cc:1505] Processing CreateTablet for tablet de4970dd965f43208c799dedd555e5dc (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260201 08:59:18.486637 17121 rpcz_store.cc:276] 0201 08:59:17.445761 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.086464 (+640703us) service_pool.cc:225] Handling call
0201 08:59:18.088218 (+ 1754us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.088307 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.428774 (+340467us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.467017 (+ 38243us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.467469 (+ 452us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.608346 17352 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:18.618613 17198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08be66650c334ab1b9d801bb366c9969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.637782 17126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c4343ae3470408987d247c06337e0a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.642195 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:18.643673 17275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4970dd965f43208c799dedd555e5dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260201 08:59:18.649427 17177 leader_election.cc:343] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.649961 17177 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:18.651257 17353 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:18.652009 17332 tablet_bootstrap.cc:654] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.634507 17199 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45864 (request call id 30) took 1061 ms. Trace:
I20260201 08:59:18.661214 17274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35836a4583949f3b2ac7cbef2205db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.544828 17201 tablet_service.cc:1505] Processing CreateTablet for tablet e4061439a0974c4d87b3541e46a95fc7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260201 08:59:18.676754 17201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4061439a0974c4d87b3541e46a95fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.676976 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:18.678644 17249 leader_election.cc:343] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.682380 17329 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:18.682946 17329 ts_tablet_manager.cc:1403] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.355s user 0.017s sys 0.002s
I20260201 08:59:18.686417 17329 raft_consensus.cc:359] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.687119 17329 raft_consensus.cc:385] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.687407 17329 raft_consensus.cc:740] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.688102 17329 consensus_queue.cc:260] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.697021 17122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de4970dd965f43208c799dedd555e5dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.704654 17327 tablet_bootstrap.cc:654] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.711762 17120 tablet_service.cc:1505] Processing CreateTablet for tablet a5c32dbf875b45d7944fd036d09edc64 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260201 08:59:18.661039 17199 rpcz_store.cc:276] 0201 08:59:17.573335 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.127349 (+554014us) service_pool.cc:225] Handling call
0201 08:59:18.317960 (+190611us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.322177 (+ 4217us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.487275 (+165098us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.633415 (+146140us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.634444 (+ 1029us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.716051 17329 ts_tablet_manager.cc:1434] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.033s user 0.009s sys 0.000s
I20260201 08:59:18.716765 17125 tablet_service.cc:1505] Processing CreateTablet for tablet c35836a4583949f3b2ac7cbef2205db2 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260201 08:59:18.717916 17121 tablet_service.cc:1505] Processing CreateTablet for tablet dc19ac6347fa40b7b6d2c6912c975575 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260201 08:59:18.732368 17329 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:18.733577 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:18.734985 17248 leader_election.cc:343] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.735417 17248 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:18.736230 17337 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:18.741252 17120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c32dbf875b45d7944fd036d09edc64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.747228 17329 tablet_bootstrap.cc:654] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.750797 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:18.715256 17270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08be66650c334ab1b9d801bb366c9969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.760392 17119 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46068 (request call id 32) took 1086 ms. Trace:
W20260201 08:59:18.760905 17101 leader_election.cc:343] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.749045 17127 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46068 (request call id 28) took 1226 ms. Trace:
I20260201 08:59:18.760785 17119 rpcz_store.cc:276] 0201 08:59:17.674105 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.166032 (+491927us) service_pool.cc:225] Handling call
0201 08:59:18.276639 (+110607us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.390010 (+113371us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f54e 00007f74b60231c9 00007f74b51791d1 00007f74b523b9d9 00007f74b51ea4c9 00007f74ae682bf4 00007f74ae682b82 00007f74ae682ab1 00007f74ae682a2c
0201 08:59:18.391682 (+ 1672us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.626116 (+234434us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.759876 (+133760us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.760337 (+ 461us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4851584}
I20260201 08:59:18.761574 17127 rpcz_store.cc:276] 0201 08:59:17.506034 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.088477 (+582443us) service_pool.cc:225] Handling call
0201 08:59:18.129841 (+ 41364us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.129942 (+ 101us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.657446 (+527504us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.732299 (+ 74853us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.732799 (+ 500us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.759920 17121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc19ac6347fa40b7b6d2c6912c975575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.765167 17125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c35836a4583949f3b2ac7cbef2205db2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.771518 17332 tablet_bootstrap.cc:492] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:18.772069 17332 ts_tablet_manager.cc:1403] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.342s user 0.021s sys 0.021s
I20260201 08:59:18.772753 17120 tablet_service.cc:1505] Processing CreateTablet for tablet 927294866f7f46cb8fa5ddd1ad31b2a9 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260201 08:59:18.774063 17120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 927294866f7f46cb8fa5ddd1ad31b2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.774878 17332 raft_consensus.cc:359] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.776580 17332 raft_consensus.cc:385] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.776911 17332 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.777688 17332 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.784595 17266 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:54608 (request call id 32) took 1066 ms. Trace:
I20260201 08:59:18.785063 17266 rpcz_store.cc:276] 0201 08:59:17.718189 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.026420 (+308231us) service_pool.cc:225] Handling call
0201 08:59:18.101231 (+ 74811us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14f0dc 00007f74ad14ec9b 00007f74b5ff9dd9 00007f74b5179260 00007f74b525e541 00007f74b523b7d3 00007f74b51ea4c9 00007f74ae682bf4 00007f74ae682b82 00007f74ae682ab1
0201 08:59:18.107643 (+ 6412us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.107741 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.716997 (+609256us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.784127 (+ 67130us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.784535 (+ 408us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13966080}
I20260201 08:59:18.786927 17332 ts_tablet_manager.cc:1434] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20260201 08:59:18.787992 17332 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:18.794835 17328 tablet_bootstrap.cc:492] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:18.795387 17328 ts_tablet_manager.cc:1403] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.607s user 0.025s sys 0.000s
I20260201 08:59:18.797994 17328 raft_consensus.cc:359] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.798655 17328 raft_consensus.cc:385] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.808923 17327 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:18.809435 17327 ts_tablet_manager.cc:1403] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.231s user 0.013s sys 0.003s
I20260201 08:59:18.810868 17332 tablet_bootstrap.cc:654] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.812537 17327 raft_consensus.cc:359] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.813335 17327 raft_consensus.cc:385] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.813630 17327 raft_consensus.cc:740] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.813885 17119 tablet_service.cc:1505] Processing CreateTablet for tablet e4061439a0974c4d87b3541e46a95fc7 (DEFAULT_TABLE table=test-workload [id=175125950fc849c9b79f42f3e4f483e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260201 08:59:18.818236 17119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4061439a0974c4d87b3541e46a95fc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 08:59:18.818354 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:18.821019 17103 leader_election.cc:343] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.821455 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:18.822566 17352 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:18.822943 17343 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.823388 17343 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.825429 17343 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:18.806035 17328 raft_consensus.cc:740] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.827605 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:18.828444 17328 consensus_queue.cc:260] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:18.829030 17027 leader_election.cc:343] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.827523 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:18.836072 17025 leader_election.cc:343] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.836524 17025 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:18.837774 17327 consensus_queue.cc:260] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.838907 17343 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:18.841100 17328 ts_tablet_manager.cc:1434] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.045s user 0.007s sys 0.000s
I20260201 08:59:18.845202 17328 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:18.858319 17328 tablet_bootstrap.cc:654] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.869674 17327 ts_tablet_manager.cc:1434] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.060s user 0.013s sys 0.006s
I20260201 08:59:18.870153 17329 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:18.870728 17329 ts_tablet_manager.cc:1403] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.139s user 0.025s sys 0.021s
I20260201 08:59:18.871102 17332 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:18.867002 17124 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:46068 (request call id 29) took 1342 ms. Trace:
I20260201 08:59:18.873220 17327 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:18.878199 17332 ts_tablet_manager.cc:1403] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.090s user 0.006s sys 0.006s
I20260201 08:59:18.881557 17332 raft_consensus.cc:359] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.882283 17332 raft_consensus.cc:385] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.883033 17332 raft_consensus.cc:740] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.883839 17332 consensus_queue.cc:260] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.885221 17328 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:18.885200 17329 raft_consensus.cc:359] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.887611 17328 ts_tablet_manager.cc:1403] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.043s user 0.012s sys 0.009s
I20260201 08:59:18.877576 17124 rpcz_store.cc:276] 0201 08:59:17.524195 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:18.123360 (+599165us) service_pool.cc:225] Handling call
0201 08:59:18.176332 (+ 52972us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0201 08:59:18.185956 (+ 9624us) ts_tablet_manager.cc:682] Creating new metadata...
0201 08:59:18.753380 (+567424us) tablet_metadata.cc:641] Metadata flushed
0201 08:59:18.866468 (+113088us) tablet_replica.cc:206] Creating consensus instance
0201 08:59:18.866923 (+ 455us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:18.887809 17329 raft_consensus.cc:385] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.886341 17332 ts_tablet_manager.cc:1434] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260201 08:59:18.888995 17329 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.887795 17327 tablet_bootstrap.cc:654] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.889999 17332 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:18.889808 17329 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.895678 17329 ts_tablet_manager.cc:1434] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.018s user 0.005s sys 0.004s
I20260201 08:59:18.896729 17329 tablet_bootstrap.cc:492] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:18.896953 17328 raft_consensus.cc:359] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.897677 17328 raft_consensus.cc:385] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.897984 17328 raft_consensus.cc:740] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.898664 17328 consensus_queue.cc:260] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.901201 17328 ts_tablet_manager.cc:1434] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260201 08:59:18.902225 17328 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:18.903541 17329 tablet_bootstrap.cc:654] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.905054 17332 tablet_bootstrap.cc:654] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.911616 17327 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:18.912355 17327 ts_tablet_manager.cc:1403] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.039s user 0.012s sys 0.005s
I20260201 08:59:18.911562 17365 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.913486 17365 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.914378 17328 tablet_bootstrap.cc:654] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.915292 17329 tablet_bootstrap.cc:492] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:18.915849 17329 ts_tablet_manager.cc:1403] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.004s
I20260201 08:59:18.915618 17327 raft_consensus.cc:359] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.916651 17327 raft_consensus.cc:385] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.917039 17327 raft_consensus.cc:740] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.917152 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:18.917886 17211 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:18.917969 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:18.919275 17027 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:18.919795 17028 leader_election.cc:343] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.920101 17343 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:18.919942 17329 raft_consensus.cc:359] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.920481 17343 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:18.915578 17365 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:18.920540 17332 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:18.920686 17329 raft_consensus.cc:385] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.921088 17343 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:18.921277 17329 raft_consensus.cc:740] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.921397 17332 ts_tablet_manager.cc:1403] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.032s user 0.012s sys 0.001s
I20260201 08:59:18.922224 17329 consensus_queue.cc:260] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:18.924364 17328 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:18.924851 17328 ts_tablet_manager.cc:1403] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.000s
I20260201 08:59:18.924903 17329 ts_tablet_manager.cc:1434] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.009s user 0.001s sys 0.004s
I20260201 08:59:18.924641 17332 raft_consensus.cc:359] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.925463 17332 raft_consensus.cc:385] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.925769 17332 raft_consensus.cc:740] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.926045 17329 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:18.926506 17332 consensus_queue.cc:260] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.929741 17328 raft_consensus.cc:359] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.930516 17328 raft_consensus.cc:385] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.930815 17328 raft_consensus.cc:740] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.931668 17328 consensus_queue.cc:260] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.932641 17329 tablet_bootstrap.cc:654] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.935621 17332 ts_tablet_manager.cc:1434] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260201 08:59:18.941282 17328 ts_tablet_manager.cc:1434] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260201 08:59:18.943535 17328 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:18.943982 17329 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:18.944501 17329 ts_tablet_manager.cc:1403] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20260201 08:59:18.945928 17343 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.947749 17329 raft_consensus.cc:359] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.917891 17327 consensus_queue.cc:260] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:18.948586 17329 raft_consensus.cc:385] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:18.948984 17329 raft_consensus.cc:740] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:18.949539 17332 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:18.950163 17343 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:18.950330 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:18.950980 17211 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:18.951205 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:18.952327 17327 ts_tablet_manager.cc:1434] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.040s user 0.003s sys 0.003s
I20260201 08:59:18.953357 17327 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:18.954303 17328 tablet_bootstrap.cc:654] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:18.952543 17028 leader_election.cc:343] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.959264 17211 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:18.961730 17027 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:18.962694 17343 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:18.963358 17343 raft_consensus.cc:697] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:18.964176 17343 consensus_queue.cc:237] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.959578 17327 tablet_bootstrap.cc:654] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:18.960035 17329 consensus_queue.cc:260] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:18.969167 17337 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:18.969664 17337 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:18.970790 17329 ts_tablet_manager.cc:1434] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.026s user 0.009s sys 0.000s
I20260201 08:59:18.971866 17337 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:18.972148 17329 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:18.975205 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:18.976639 17249 leader_election.cc:343] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:18.980736 17329 tablet_bootstrap.cc:654] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.001657 17337 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.002238 17337 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.004191 17337 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.006520 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.007252 17062 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:19.006970 16957 catalog_manager.cc:5654] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:19.008229 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:19.009724 17248 leader_election.cc:343] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.010896 17249 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:19.012204 17337 raft_consensus.cc:2804] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.012648 17337 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.013759 17337 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.021651 17337 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.024385 17332 tablet_bootstrap.cc:654] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.027323 17327 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.027998 17327 ts_tablet_manager.cc:1403] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.075s user 0.015s sys 0.009s
I20260201 08:59:19.031206 17327 raft_consensus.cc:359] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.032016 17327 raft_consensus.cc:385] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.032320 17327 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.033039 17327 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.035245 17328 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:19.035862 17328 ts_tablet_manager.cc:1403] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.093s user 0.033s sys 0.050s
I20260201 08:59:19.037351 17329 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:19.037870 17329 ts_tablet_manager.cc:1403] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.066s user 0.023s sys 0.017s
I20260201 08:59:19.035295 17327 ts_tablet_manager.cc:1434] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:59:19.039194 17327 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:19.039316 17337 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.075536 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:19.076081 17328 raft_consensus.cc:359] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.077795 17328 raft_consensus.cc:385] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.078260 17328 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.078043 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.079397 17328 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.080116 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:19.080962 17062 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.081311 17352 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.081315 17353 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.082261 17352 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.082350 17353 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.087317 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.088392 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.089218 17353 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:19.089963 17250 leader_election.cc:343] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.088507 17061 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:19.090684 17250 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:19.090883 17101 leader_election.cc:343] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.091778 17175 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:19.092084 17352 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:19.092805 17352 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:19.093640 17248 leader_election.cc:343] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.094259 17337 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.095083 17337 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.096237 17332 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.097304 17332 ts_tablet_manager.cc:1403] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.148s user 0.010s sys 0.005s
I20260201 08:59:19.092825 17353 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.099822 17353 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.100239 17353 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.103287 17332 raft_consensus.cc:359] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.104333 17332 raft_consensus.cc:385] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.104647 17332 raft_consensus.cc:740] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.116065 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.116770 17328 ts_tablet_manager.cc:1434] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.081s user 0.011s sys 0.023s
I20260201 08:59:19.116495 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.118121 17337 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:19.119369 17248 leader_election.cc:343] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.121006 17328 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:19.093719 17352 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.122880 17337 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.125268 17332 consensus_queue.cc:260] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.126443 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.108642 17329 raft_consensus.cc:359] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.127869 17329 raft_consensus.cc:385] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.128269 17329 raft_consensus.cc:740] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
W20260201 08:59:19.128455 17103 leader_election.cc:343] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.129084 17136 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:19.129362 17329 consensus_queue.cc:260] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:19.136582 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 46982.9us
I20260201 08:59:19.133141 17352 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.146039 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.146845 17211 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:19.152417 17250 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:19.153532 17384 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.153971 17384 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.154310 17384 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.162145 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.162714 17327 tablet_bootstrap.cc:654] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.162967 17211 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:19.163900 17384 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.165216 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.141109 17332 ts_tablet_manager.cc:1434] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.042s user 0.005s sys 0.006s
I20260201 08:59:19.147997 17353 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.170413 17332 tablet_bootstrap.cc:492] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.170454 17384 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:19.173888 17102 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:19.174913 17352 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260201 08:59:19.175277 17102 leader_election.cc:343] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.175315 17352 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.175909 17352 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.175873 17102 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.177688 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:19.179381 17248 leader_election.cc:343] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.182663 17332 tablet_bootstrap.cc:654] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.183198 17385 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.183447 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:19.183920 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:19.184085 17061 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.185156 17382 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.185542 17385 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.186372 17352 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.190768 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:19.192296 17101 leader_election.cc:343] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.188071 17211 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.182634 17353 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.200073 17062 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:19.204440 17249 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:19.205149 17328 tablet_bootstrap.cc:654] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.205310 17384 raft_consensus.cc:2804] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.205978 17384 raft_consensus.cc:697] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:19.201087 17061 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:19.200073 17352 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:19.207072 17385 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:19.207882 17384 consensus_queue.cc:237] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.208367 17175 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:19.208554 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:19.207998 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:19.215855 17210 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.215998 17136 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.217510 17343 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.218154 17343 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.222002 17385 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.222406 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.222703 17353 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.223125 17209 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:19.223198 17353 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.210088 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.224764 17210 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:19.225210 17353 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.222406 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.226172 17136 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
W20260201 08:59:19.226585 17177 leader_election.cc:343] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.211570 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.222543 17385 raft_consensus.cc:697] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:19.227252 17027 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:19.228027 17385 consensus_queue.cc:237] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:19.229128 17028 leader_election.cc:343] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.230242 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.210923 17329 ts_tablet_manager.cc:1434] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.173s user 0.006s sys 0.007s
W20260201 08:59:19.231936 17175 leader_election.cc:343] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.227427 17061 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:19.233656 17365 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.233228 17343 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.233812 17102 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:19.212670 17211 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:19.232059 17329 tablet_bootstrap.cc:492] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:19.237792 17387 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.238147 17365 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.237064 17352 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.245141 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:19.246999 17174 leader_election.cc:343] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.247526 17174 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:19.249181 17389 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.241604 17365 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.254093 17382 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.254707 17382 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.243845 17175 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.258245 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.258966 17387 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:19.259688 17103 leader_election.cc:343] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.262164 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.262996 17061 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:19.264340 17101 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.264945 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.265475 17382 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:19.266707 17382 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.267149 17382 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.265594 17284 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:19.267937 17382 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.268967 17177 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:19.267490 17328 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:19.252580 17352 raft_consensus.cc:697] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:19.270143 17328 ts_tablet_manager.cc:1403] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.150s user 0.017s sys 0.004s
I20260201 08:59:19.272164 17389 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.272717 17332 tablet_bootstrap.cc:492] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.272665 17389 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.274668 17250 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:19.276074 17385 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:19.276142 17383 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.264267 17387 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.273279 17332 ts_tablet_manager.cc:1403] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.103s user 0.012s sys 0.016s
I20260201 08:59:19.273308 17389 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.282632 17327 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.283012 17385 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.283331 17327 ts_tablet_manager.cc:1403] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.244s user 0.010s sys 0.011s
I20260201 08:59:19.278087 17383 raft_consensus.cc:697] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:19.284063 17385 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:19.285549 17383 consensus_queue.cc:237] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.284010 17352 consensus_queue.cc:237] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.289008 17365 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.289736 17328 raft_consensus.cc:359] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.290448 17328 raft_consensus.cc:385] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.290733 17328 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.291769 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:19.291543 17328 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.280129 16959 catalog_manager.cc:5654] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:19.294205 17328 ts_tablet_manager.cc:1434] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260201 08:59:19.295435 17328 tablet_bootstrap.cc:492] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:19.287178 17327 raft_consensus.cc:359] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.300678 17327 raft_consensus.cc:385] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.301059 17327 raft_consensus.cc:740] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.301396 17365 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.304329 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:19.305076 17284 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.301781 17327 consensus_queue.cc:260] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.307606 17389 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.308887 17210 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 1: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:19.309947 17332 raft_consensus.cc:359] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.310704 17332 raft_consensus.cc:385] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.311014 17332 raft_consensus.cc:740] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.311826 17332 consensus_queue.cc:260] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.317981 17284 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:19.319141 17028 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:19.321493 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:19.320396 17329 tablet_bootstrap.cc:654] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.322666 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:19.323803 17061 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 1: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:19.324254 17343 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.324764 17343 raft_consensus.cc:697] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:19.326036 17327 ts_tablet_manager.cc:1434] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.042s user 0.003s sys 0.004s
I20260201 08:59:19.325846 17343 consensus_queue.cc:237] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.327236 17332 ts_tablet_manager.cc:1434] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.049s user 0.004s sys 0.003s
I20260201 08:59:19.320537 17389 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:19.327344 17328 tablet_bootstrap.cc:654] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.328181 17327 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:19.334640 17385 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.327916 17284 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 1: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:19.330935 17332 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.337296 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:19.337922 17177 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.339073 17389 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.344236 17382 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.346454 17382 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:19.347339 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:19.347585 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:19.348214 17061 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:19.348834 17103 leader_election.cc:343] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.385172 17385 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.339618 16957 catalog_manager.cc:5654] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:19.398873 17332 tablet_bootstrap.cc:654] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.402272 17327 tablet_bootstrap.cc:654] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.396339 16958 catalog_manager.cc:5654] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:19.420029 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:19.420712 17135 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 2
I20260201 08:59:19.420137 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.429827 17328 tablet_bootstrap.cc:492] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:19.430385 17328 ts_tablet_manager.cc:1403] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.135s user 0.015s sys 0.004s
I20260201 08:59:19.431173 16959 catalog_manager.cc:5654] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:19.433180 17328 raft_consensus.cc:359] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.433890 17328 raft_consensus.cc:385] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.434165 17328 raft_consensus.cc:740] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.438593 17329 tablet_bootstrap.cc:492] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:19.439086 17329 ts_tablet_manager.cc:1403] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.207s user 0.008s sys 0.010s
I20260201 08:59:19.440124 17135 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:19.442157 17332 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.442664 17332 ts_tablet_manager.cc:1403] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.112s user 0.011s sys 0.004s
I20260201 08:59:19.442349 17329 raft_consensus.cc:359] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.443382 17329 raft_consensus.cc:385] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.443714 17329 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.444466 17329 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.445603 17174 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.446774 17329 ts_tablet_manager.cc:1434] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260201 08:59:19.439890 17328 consensus_queue.cc:260] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.447316 17385 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:19.447824 17385 raft_consensus.cc:697] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:19.445561 17332 raft_consensus.cc:359] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.450598 17061 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:19.450788 17332 raft_consensus.cc:385] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.451174 17332 raft_consensus.cc:740] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.451887 17332 consensus_queue.cc:260] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.452168 17101 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.453318 17395 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.452997 17385 consensus_queue.cc:237] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.453802 17395 raft_consensus.cc:697] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:19.454710 17395 consensus_queue.cc:237] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.455963 17327 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.456458 17327 ts_tablet_manager.cc:1403] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.129s user 0.011s sys 0.007s
I20260201 08:59:19.459052 17327 raft_consensus.cc:359] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.459682 17327 raft_consensus.cc:385] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.459973 17327 raft_consensus.cc:740] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.461284 17352 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.461470 16958 catalog_manager.cc:5654] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:19.463492 17329 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:19.461782 17352 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.463364 17332 ts_tablet_manager.cc:1434] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.020s user 0.004s sys 0.004s
I20260201 08:59:19.465240 17352 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:19.465934 17332 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.466919 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.467682 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.467684 17061 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
W20260201 08:59:19.469043 17102 leader_election.cc:343] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.469652 17101 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:19.470268 17352 raft_consensus.cc:2804] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.463410 17328 ts_tablet_manager.cc:1434] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.033s user 0.008s sys 0.000s
I20260201 08:59:19.474035 17328 tablet_bootstrap.cc:492] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:19.476600 17343 consensus_queue.cc:1048] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.470676 17352 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.479163 17352 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.480494 17328 tablet_bootstrap.cc:654] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.480199 16957 catalog_manager.cc:5654] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:19.460561 17327 consensus_queue.cc:260] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.487293 17352 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.490314 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:19.490592 17327 ts_tablet_manager.cc:1434] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260201 08:59:19.493624 17327 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
W20260201 08:59:19.493969 17102 leader_election.cc:343] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.496958 17329 tablet_bootstrap.cc:654] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.498750 16958 catalog_manager.cc:5654] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:19.502396 17352 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:19.506006 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:19.506618 17061 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.512393 17332 tablet_bootstrap.cc:654] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.513638 17329 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:19.515045 17061 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:19.516644 17327 tablet_bootstrap.cc:654] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.515432 17329 ts_tablet_manager.cc:1403] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.000s
I20260201 08:59:19.520331 17329 raft_consensus.cc:359] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.521132 17329 raft_consensus.cc:385] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.521459 17329 raft_consensus.cc:740] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.517500 17101 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:19.516219 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:19.522957 17328 tablet_bootstrap.cc:492] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:19.523442 17328 ts_tablet_manager.cc:1403] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.007s
I20260201 08:59:19.522416 17329 consensus_queue.cc:260] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.525882 17329 ts_tablet_manager.cc:1434] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:59:19.526983 17329 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:19.528712 17352 raft_consensus.cc:2804] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.529251 17352 raft_consensus.cc:697] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:19.530072 17352 consensus_queue.cc:237] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.526171 17328 raft_consensus.cc:359] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.531426 17328 raft_consensus.cc:385] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.531733 17328 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.532521 17328 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.533993 17329 tablet_bootstrap.cc:654] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.535956 17328 ts_tablet_manager.cc:1434] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260201 08:59:19.542263 17328 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
W20260201 08:59:19.555756 17028 consensus_peers.cc:597] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:19.556423 17332 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.556740 17327 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.556551 17365 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.556980 17332 ts_tablet_manager.cc:1403] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.091s user 0.033s sys 0.012s
I20260201 08:59:19.557174 17327 ts_tablet_manager.cc:1403] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.064s user 0.008s sys 0.006s
I20260201 08:59:19.557348 17365 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.559715 17332 raft_consensus.cc:359] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.560360 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.561203 17327 raft_consensus.cc:359] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.561834 17327 raft_consensus.cc:385] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260201 08:59:19.561934 17025 leader_election.cc:343] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.560382 17332 raft_consensus.cc:385] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.562620 17332 raft_consensus.cc:740] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.563390 17332 consensus_queue.cc:260] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.564138 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:19.565449 17027 leader_election.cc:343] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.565910 17332 ts_tablet_manager.cc:1434] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260201 08:59:19.566243 17365 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:19.566018 17027 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:19.566002 16957 catalog_manager.cc:5654] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:19.567239 17332 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.567394 17328 tablet_bootstrap.cc:654] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.568068 17365 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.562124 17327 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.573552 17327 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.574328 17329 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:19.574754 17329 ts_tablet_manager.cc:1403] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.048s user 0.015s sys 0.000s
I20260201 08:59:19.575625 17327 ts_tablet_manager.cc:1434] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260201 08:59:19.572785 17383 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.576624 17327 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:19.577286 17329 raft_consensus.cc:359] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.577955 17329 raft_consensus.cc:385] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.578202 17329 raft_consensus.cc:740] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.576475 17383 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.578933 17329 consensus_queue.cc:260] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.580924 17383 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.581137 17329 ts_tablet_manager.cc:1434] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:19.582677 17327 tablet_bootstrap.cc:654] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.582744 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.583635 17385 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:19.584233 17248 leader_election.cc:343] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.584126 17385 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.585454 17332 tablet_bootstrap.cc:654] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.586448 17385 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.587996 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.588706 17285 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:19.590847 17177 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:19.592051 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.592720 17135 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:19.593302 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.594504 17385 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260201 08:59:19.594620 17249 leader_election.cc:343] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.595017 17385 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.595224 17249 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:19.595518 17385 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.596057 17383 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.603735 17385 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.611093 17329 tablet_bootstrap.cc:492] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:19.617296 17385 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.618623 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:19.619381 17285 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.621752 17332 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.622249 17332 ts_tablet_manager.cc:1403] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.055s user 0.014s sys 0.012s
I20260201 08:59:19.622464 17329 tablet_bootstrap.cc:654] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.624485 17327 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.624994 17327 ts_tablet_manager.cc:1403] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.049s user 0.020s sys 0.007s
I20260201 08:59:19.622367 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:19.626389 17135 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.627496 17327 raft_consensus.cc:359] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.628166 17327 raft_consensus.cc:385] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.628417 17327 raft_consensus.cc:740] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.628973 17327 consensus_queue.cc:260] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.631209 17332 raft_consensus.cc:359] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.634505 17332 raft_consensus.cc:385] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.634835 17332 raft_consensus.cc:740] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.635543 17328 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:19.636065 17328 ts_tablet_manager.cc:1403] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.094s user 0.014s sys 0.034s
I20260201 08:59:19.635617 17332 consensus_queue.cc:260] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.633842 17135 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:19.634200 17329 tablet_bootstrap.cc:492] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:19.638921 17329 ts_tablet_manager.cc:1403] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.008s
I20260201 08:59:19.639452 17174 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:19.640295 17385 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.636504 17285 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:19.640748 17385 raft_consensus.cc:697] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:19.640936 17328 raft_consensus.cc:359] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.637856 17332 ts_tablet_manager.cc:1434] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260201 08:59:19.638317 17327 ts_tablet_manager.cc:1434] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260201 08:59:19.641602 17385 consensus_queue.cc:237] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.642660 17327 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:19.644064 17332 tablet_bootstrap.cc:492] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.649688 17332 tablet_bootstrap.cc:654] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.641605 17328 raft_consensus.cc:385] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.650475 17328 raft_consensus.cc:740] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.651943 17327 tablet_bootstrap.cc:654] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.652065 17328 consensus_queue.cc:260] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.652930 17329 raft_consensus.cc:359] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.653656 17329 raft_consensus.cc:385] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.653937 17329 raft_consensus.cc:740] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.654666 17329 consensus_queue.cc:260] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.657323 17329 ts_tablet_manager.cc:1434] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260201 08:59:19.658540 17329 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:19.659600 17328 ts_tablet_manager.cc:1434] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.023s user 0.003s sys 0.004s
I20260201 08:59:19.660727 17328 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:19.666869 17383 consensus_queue.cc:1048] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.668656 17329 tablet_bootstrap.cc:654] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.670511 17327 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.671092 17327 ts_tablet_manager.cc:1403] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.029s user 0.014s sys 0.010s
I20260201 08:59:19.673594 17343 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.673794 17327 raft_consensus.cc:359] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.674122 17343 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.674647 17327 raft_consensus.cc:385] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.675067 17327 raft_consensus.cc:740] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.675814 17327 consensus_queue.cc:260] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.678216 17327 ts_tablet_manager.cc:1434] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:59:19.678956 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.679330 17327 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:19.679898 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.681933 17343 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.680641 17285 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:19.685093 17328 tablet_bootstrap.cc:654] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.685717 17327 tablet_bootstrap.cc:654] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.686228 17028 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:19.688963 17332 tablet_bootstrap.cc:492] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.689426 17332 ts_tablet_manager.cc:1403] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.046s user 0.017s sys 0.001s
W20260201 08:59:19.689890 17248 consensus_peers.cc:597] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c -> Peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Couldn't send request to peer 3dee892ea94d4f2a92316ad6f79edca2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:19.690959 16957 catalog_manager.cc:5654] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:19.693820 17329 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:19.694283 17329 ts_tablet_manager.cc:1403] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.004s
I20260201 08:59:19.694124 17385 consensus_queue.cc:1048] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.691974 17332 raft_consensus.cc:359] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.696772 17332 raft_consensus.cc:385] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.697089 17332 raft_consensus.cc:740] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.697724 17332 consensus_queue.cc:260] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.699779 17332 ts_tablet_manager.cc:1434] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.010s user 0.004s sys 0.000s
I20260201 08:59:19.700779 17332 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.692368 17343 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.693022 17135 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:19.702984 17343 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.704975 17329 raft_consensus.cc:359] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.706018 17329 raft_consensus.cc:385] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.706324 17329 raft_consensus.cc:740] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.706123 17343 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.707044 17329 consensus_queue.cc:260] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.709218 17329 ts_tablet_manager.cc:1434] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.015s user 0.005s sys 0.002s
I20260201 08:59:19.710255 17329 tablet_bootstrap.cc:492] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:19.715965 17329 tablet_bootstrap.cc:654] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.718843 17332 tablet_bootstrap.cc:654] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.721246 17385 consensus_queue.cc:1048] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.729209 17210 raft_consensus.cc:1240] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:19.737044 17383 consensus_queue.cc:1059] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:19.738188 17383 consensus_queue.cc:1243] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer f5398ba4a58b40ca9b78a210cdb7ae4d log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260201 08:59:19.750680 17337 raft_consensus.cc:3055] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:19.751106 17337 raft_consensus.cc:740] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:19.751973 17337 consensus_queue.cc:260] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.753618 17337 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:19.765059 17383 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.766137 17383 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.769179 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.769894 17135 raft_consensus.cc:2468] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:19.771304 17248 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:19.773840 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.774572 17210 raft_consensus.cc:2468] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:19.736570 17343 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.790381 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:19.791040 17285 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.792977 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:19.793656 17135 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.798949 17285 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:19.800392 17028 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:19.801280 17135 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:19.801481 17365 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:19.802706 17343 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.802752 17365 raft_consensus.cc:697] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:19.803890 17365 consensus_queue.cc:237] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.808332 17343 consensus_queue.cc:1048] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.809144 17352 consensus_queue.cc:1048] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.824579 17433 raft_consensus.cc:2804] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.825068 17433 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.825388 17433 raft_consensus.cc:3060] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:19.843151 17101 consensus_peers.cc:597] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:19.845598 17343 consensus_queue.cc:1048] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.790995 17383 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:19.742528 17329 tablet_bootstrap.cc:492] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:19.748034 17332 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.851727 17332 ts_tablet_manager.cc:1403] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.151s user 0.013s sys 0.003s
W20260201 08:59:19.853461 17103 consensus_peers.cc:597] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:19.854664 17332 raft_consensus.cc:359] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.855445 17332 raft_consensus.cc:385] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.855729 17332 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.856400 17332 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.858836 17332 ts_tablet_manager.cc:1434] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260201 08:59:19.851655 17329 ts_tablet_manager.cc:1403] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.142s user 0.008s sys 0.004s
I20260201 08:59:19.861932 17329 raft_consensus.cc:359] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.862668 17329 raft_consensus.cc:385] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.862926 17329 raft_consensus.cc:740] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.864173 17332 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.875617 17332 tablet_bootstrap.cc:654] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.879839 17329 consensus_queue.cc:260] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.881433 16957 catalog_manager.cc:5654] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:19.882349 17329 ts_tablet_manager.cc:1434] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260201 08:59:19.883666 17329 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:19.885273 17327 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.885759 17327 ts_tablet_manager.cc:1403] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.207s user 0.086s sys 0.106s
I20260201 08:59:19.887776 17332 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:19.888231 17332 ts_tablet_manager.cc:1403] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.004s
I20260201 08:59:19.888146 17327 raft_consensus.cc:359] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.888936 17327 raft_consensus.cc:385] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.889206 17327 raft_consensus.cc:740] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.889921 17327 consensus_queue.cc:260] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.890904 17332 raft_consensus.cc:359] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.891628 17332 raft_consensus.cc:385] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.891927 17327 ts_tablet_manager.cc:1434] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260201 08:59:19.891902 17332 raft_consensus.cc:740] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.893107 17327 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:19.892850 17332 consensus_queue.cc:260] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.895223 17332 ts_tablet_manager.cc:1434] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260201 08:59:19.896210 17332 tablet_bootstrap.cc:492] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:19.899168 17327 tablet_bootstrap.cc:654] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.905750 17337 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.907042 17337 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.911340 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:19.913162 17250 leader_election.cc:343] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.914256 17211 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.864122 17328 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:19.917270 17328 ts_tablet_manager.cc:1403] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.257s user 0.008s sys 0.009s
I20260201 08:59:19.916682 17329 tablet_bootstrap.cc:654] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.908670 17332 tablet_bootstrap.cc:654] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:19.920029 17328 raft_consensus.cc:359] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.921207 17389 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.921700 17389 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.922863 17395 consensus_queue.cc:1048] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.923563 17389 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.925356 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:19.927692 17177 leader_election.cc:343] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.928726 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:19.930294 17174 leader_election.cc:343] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.930733 17174 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.932108 17387 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.933430 17337 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:19.933944 17136 raft_consensus.cc:1275] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260201 08:59:19.934510 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.935714 17385 consensus_queue.cc:1048] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 08:59:19.935959 17249 leader_election.cc:343] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.936746 17249 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:19.943419 17430 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.947371 17433 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.949218 17439 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.949841 17439 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.951565 17395 consensus_queue.cc:1048] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:19.952831 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.955204 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.958381 17210 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:19.959826 17431 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.960384 17431 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.962548 17431 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.963073 17431 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.963537 17431 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:19.965449 17389 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.966010 17389 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.966578 17027 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:19.968117 17365 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.968458 17365 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:19.968593 17327 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:19.968801 17365 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:19.969116 17389 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:19.969105 17327 ts_tablet_manager.cc:1403] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.076s user 0.034s sys 0.032s
I20260201 08:59:19.970701 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.970996 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.972029 17327 raft_consensus.cc:359] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.972402 17175 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:19.972733 17327 raft_consensus.cc:385] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.973085 17327 raft_consensus.cc:740] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.973585 17389 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:19.957222 17385 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.973690 17327 consensus_queue.cc:260] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.974275 17385 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:19.966665 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.975937 17327 ts_tablet_manager.cc:1434] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260201 08:59:19.976950 17327 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:19.978650 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:19.978974 17332 tablet_bootstrap.cc:492] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
W20260201 08:59:19.979501 17028 leader_election.cc:343] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.979468 17332 ts_tablet_manager.cc:1403] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.083s user 0.010s sys 0.001s
I20260201 08:59:19.982019 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:19.982514 17327 tablet_bootstrap.cc:654] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:19.982631 17177 leader_election.cc:343] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.982836 17395 consensus_queue.cc:1048] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:19.985772 17332 raft_consensus.cc:359] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:19.984517 17174 leader_election.cc:343] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.986421 17332 raft_consensus.cc:385] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:19.981439 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.986645 17174 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.987465 17449 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:19.987749 17389 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:19.987915 17027 leader_election.cc:343] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.988761 17431 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.988595 17027 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.986706 17332 raft_consensus.cc:740] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:19.989460 17449 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:19.990646 17343 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.990820 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.983400 17385 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:19.992132 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:19.993083 17027 leader_election.cc:343] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.994606 17284 raft_consensus.cc:1275] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260201 08:59:19.994997 17284 pending_rounds.cc:85] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: Aborting all ops after (but not including) 0
I20260201 08:59:19.995223 17332 consensus_queue.cc:260] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:19.996240 17028 leader_election.cc:343] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:19.996729 17028 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:19.997473 17343 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:19.997728 17449 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:19.998001 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:19.998873 17210 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:19.999673 17332 ts_tablet_manager.cc:1434] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260201 08:59:19.999787 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:20.000718 17332 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.001082 17449 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:19.995245 17284 pending_rounds.cc:107] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260201 08:59:20.001579 17449 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.001628 17284 raft_consensus.cc:2889] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:20.002133 17449 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.002861 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:19.920786 17328 raft_consensus.cc:385] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.003849 17328 raft_consensus.cc:740] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.004359 17328 consensus_queue.cc:260] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:19.955850 17439 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.006487 17389 consensus_queue.cc:1048] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.011031 17433 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.013051 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:20.013650 17137 raft_consensus.cc:3060] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.014824 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:20.015425 17210 raft_consensus.cc:3060] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.008944 17365 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.017251 17061 raft_consensus.cc:2393] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 1: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:20.018975 17365 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.019639 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:20.020231 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:20.037053 17328 ts_tablet_manager.cc:1434] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.119s user 0.007s sys 0.000s
I20260201 08:59:20.020279 17211 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.043123 17327 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:20.043649 17327 ts_tablet_manager.cc:1403] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.067s user 0.010s sys 0.006s
I20260201 08:59:20.045285 17332 tablet_bootstrap.cc:654] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.048396 17329 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.048914 17329 ts_tablet_manager.cc:1403] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.166s user 0.015s sys 0.003s
I20260201 08:59:20.046010 17447 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.046116 17327 raft_consensus.cc:359] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.046506 17137 raft_consensus.cc:2468] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:20.051894 17327 raft_consensus.cc:385] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.051581 17365 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.053813 17328 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:20.055218 17327 raft_consensus.cc:740] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.057397 17327 consensus_queue.cc:260] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.054703 17248 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:20.059708 17433 raft_consensus.cc:2804] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.060098 17433 raft_consensus.cc:697] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:20.059826 17365 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.060801 17433 consensus_queue.cc:237] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.061836 17365 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.062369 17447 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.063221 17327 ts_tablet_manager.cc:1434] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260201 08:59:20.063450 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.064106 17389 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.064548 17389 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:20.064893 17028 leader_election.cc:343] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.065845 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:20.066572 17137 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:20.067757 17025 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.068872 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.069061 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:20.069281 17343 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.069635 17209 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:20.069751 17343 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.070173 17343 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.070837 17102 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:20.066493 17389 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.071599 17352 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.071959 17352 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.072297 17352 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.072753 17447 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:20.073015 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.054167 17210 raft_consensus.cc:2468] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:20.058336 17329 raft_consensus.cc:359] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.078023 17329 raft_consensus.cc:385] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.078315 17329 raft_consensus.cc:740] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
W20260201 08:59:20.080534 17103 leader_election.cc:343] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.082264 17329 consensus_queue.cc:260] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.081782 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.084815 17283 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.093102 17062 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.094374 17175 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:20.084784 17211 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:20.095810 17389 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.087261 17332 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:20.095628 17343 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.096254 17389 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.096532 17332 ts_tablet_manager.cc:1403] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.096s user 0.012s sys 0.004s
I20260201 08:59:20.096632 17389 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.096997 17027 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:20.098173 17431 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.098718 17431 raft_consensus.cc:697] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:20.100106 17328 tablet_bootstrap.cc:654] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.099704 17431 consensus_queue.cc:237] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.103106 17385 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.103713 17343 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.089053 17352 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.091497 17327 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:20.109282 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:20.109925 17134 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.114709 17327 tablet_bootstrap.cc:654] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.085655 17449 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.105228 17332 raft_consensus.cc:359] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.105219 17329 ts_tablet_manager.cc:1434] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.056s user 0.005s sys 0.001s
I20260201 08:59:20.118455 17332 raft_consensus.cc:385] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.118798 17332 raft_consensus.cc:740] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.119275 17329 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.119578 17332 consensus_queue.cc:260] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.121387 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:20.122731 17028 leader_election.cc:343] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.126819 17332 ts_tablet_manager.cc:1434] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20260201 08:59:20.129113 17135 raft_consensus.cc:2393] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 1: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:20.129384 17332 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.137612 17332 tablet_bootstrap.cc:654] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.137368 16960 catalog_manager.cc:5654] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:20.107406 17389 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.142035 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:20.142621 17284 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.149646 17329 tablet_bootstrap.cc:654] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.156684 17332 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:20.157279 17332 ts_tablet_manager.cc:1403] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.003s
I20260201 08:59:20.157780 17352 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:20.148926 17382 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.161713 17382 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.162043 17449 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.163575 17382 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.153012 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:20.168999 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:20.169348 17210 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.169767 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:20.173183 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:20.174675 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:20.175021 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.175405 17134 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
W20260201 08:59:20.175952 17102 leader_election.cc:343] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.176563 17025 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.176826 17327 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:20.177758 17343 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.177872 17327 ts_tablet_manager.cc:1403] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.087s user 0.015s sys 0.013s
I20260201 08:59:20.178243 17343 raft_consensus.cc:697] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:20.179105 17343 consensus_queue.cc:237] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:20.171562 17103 leader_election.cc:343] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.179693 16959 catalog_manager.cc:5654] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.180722 17327 raft_consensus.cc:359] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.181587 17209 raft_consensus.cc:2393] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 1: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:20.182901 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:20.181584 17327 raft_consensus.cc:385] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.183516 17327 raft_consensus.cc:740] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.184136 17327 consensus_queue.cc:260] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.184506 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:20.181536 17101 leader_election.cc:343] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.186832 17101 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:20.187451 17449 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:20.189459 17328 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:20.189832 17328 ts_tablet_manager.cc:1403] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.136s user 0.014s sys 0.017s
I20260201 08:59:20.187855 17061 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.187983 17382 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260201 08:59:20.192173 17455 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.196969 17284 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.200594 17327 ts_tablet_manager.cc:1434] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260201 08:59:20.203297 17332 raft_consensus.cc:359] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.204008 17332 raft_consensus.cc:385] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.204254 17332 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.192770 17455 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.208139 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.208340 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:20.208758 17062 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.208952 17134 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.209977 17175 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:20.210441 17455 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.210801 17385 raft_consensus.cc:2804] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.185181 17389 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.211167 17385 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.211514 17385 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.211727 17061 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.213490 17332 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.216471 17332 ts_tablet_manager.cc:1434] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.059s user 0.005s sys 0.001s
I20260201 08:59:20.214411 17177 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:20.217464 17332 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.218119 17327 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:20.220346 17385 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.221436 17455 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.223423 17332 tablet_bootstrap.cc:654] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.259876 17385 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.260625 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:20.261418 17136 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.274782 16958 catalog_manager.cc:5654] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.282379 17329 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.282922 17329 ts_tablet_manager.cc:1403] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.164s user 0.016s sys 0.014s
I20260201 08:59:20.288168 17343 consensus_queue.cc:1048] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.283692 17328 raft_consensus.cc:359] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.291018 17328 raft_consensus.cc:385] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.291399 17328 raft_consensus.cc:740] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.292243 17385 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:20.293054 17210 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:20.291601 17329 raft_consensus.cc:359] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.294483 17329 raft_consensus.cc:385] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.294736 17329 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.295437 17102 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.295388 17329 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.297115 17382 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.299118 17382 raft_consensus.cc:697] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:20.298273 17329 ts_tablet_manager.cc:1434] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.015s user 0.003s sys 0.004s
I20260201 08:59:20.313330 17332 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:20.295487 17136 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.314478 17329 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.313932 17332 ts_tablet_manager.cc:1403] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.097s user 0.013s sys 0.049s
I20260201 08:59:20.304322 17455 raft_consensus.cc:697] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:20.305316 17285 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.317126 17174 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:20.316931 17455 consensus_queue.cc:237] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.318033 17463 raft_consensus.cc:2804] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.318514 17463 raft_consensus.cc:697] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:20.319514 17463 consensus_queue.cc:237] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.322531 17382 consensus_queue.cc:237] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.306243 17328 consensus_queue.cc:260] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.325984 17329 tablet_bootstrap.cc:654] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.326401 17328 ts_tablet_manager.cc:1434] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.136s user 0.001s sys 0.005s
I20260201 08:59:20.327569 17328 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
W20260201 08:59:20.283196 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 61090.3us
I20260201 08:59:20.318356 17332 raft_consensus.cc:359] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.332397 17332 raft_consensus.cc:385] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.333796 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:20.334452 17061 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.332779 17332 raft_consensus.cc:740] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.335420 17332 consensus_queue.cc:260] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.337622 17332 ts_tablet_manager.cc:1434] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.022s user 0.004s sys 0.002s
I20260201 08:59:20.338600 17332 tablet_bootstrap.cc:492] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.340526 16958 catalog_manager.cc:5654] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.341971 17061 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.298488 17327 tablet_bootstrap.cc:654] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.344117 17332 tablet_bootstrap.cc:654] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.349232 17329 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.349804 17329 ts_tablet_manager.cc:1403] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.036s user 0.021s sys 0.007s
I20260201 08:59:20.352808 17329 raft_consensus.cc:359] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.354141 17329 raft_consensus.cc:385] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.354475 17329 raft_consensus.cc:740] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.355160 17329 consensus_queue.cc:260] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.357894 17329 ts_tablet_manager.cc:1434] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260201 08:59:20.360155 17329 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.366698 16958 catalog_manager.cc:5654] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:20.368599 17329 tablet_bootstrap.cc:654] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.378515 17061 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.380188 17329 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.380884 17329 ts_tablet_manager.cc:1403] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.001s
I20260201 08:59:20.381183 17455 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.381727 17455 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.383698 17455 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.385447 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:20.387133 17177 leader_election.cc:343] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.383877 17329 raft_consensus.cc:359] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.388185 17329 raft_consensus.cc:385] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.388530 17329 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.390122 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.390803 17062 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.389310 17329 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.406363 17175 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.407534 17455 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.407920 17455 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.408249 17455 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.409550 17343 consensus_queue.cc:1048] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:20.415184 17433 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:20.419413 17433 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.421710 17329 ts_tablet_manager.cc:1434] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.040s user 0.007s sys 0.000s
I20260201 08:59:20.422770 17329 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.423965 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:20.417811 17466 log.cc:927] Time spent T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
I20260201 08:59:20.428788 17328 tablet_bootstrap.cc:654] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.425024 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:20.425633 17433 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.436535 17248 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:20.438062 17433 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:20.440699 17455 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.442379 17449 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.442584 17327 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:20.443248 17327 ts_tablet_manager.cc:1403] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.225s user 0.016s sys 0.006s
I20260201 08:59:20.443096 17449 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.443518 17455 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.447506 17449 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.448122 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:20.449148 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:20.449658 17177 leader_election.cc:343] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.450721 17332 tablet_bootstrap.cc:492] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:20.451105 17332 ts_tablet_manager.cc:1403] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.113s user 0.031s sys 0.050s
I20260201 08:59:20.449842 17062 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:20.453164 17101 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:20.455574 17332 raft_consensus.cc:359] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.452471 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:20.456750 17062 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.459860 16958 catalog_manager.cc:5654] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.456297 17332 raft_consensus.cc:385] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.462275 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.459771 17329 tablet_bootstrap.cc:654] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.466085 17332 raft_consensus.cc:740] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.461614 17382 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.469133 17332 consensus_queue.cc:260] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.474419 17332 ts_tablet_manager.cc:1434] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.023s user 0.005s sys 0.001s
I20260201 08:59:20.475358 17332 tablet_bootstrap.cc:492] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.478154 17365 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:20.478681 17365 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.485714 17327 raft_consensus.cc:359] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.486438 17327 raft_consensus.cc:385] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.486698 17327 raft_consensus.cc:740] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.487315 17327 consensus_queue.cc:260] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.487908 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:20.485934 17103 leader_election.cc:343] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.480994 17337 consensus_queue.cc:1048] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260201 08:59:20.489391 17455 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.489996 17455 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.493475 17332 tablet_bootstrap.cc:654] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.494765 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.469987 17382 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.500155 17365 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.509239 17382 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.509712 17395 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.510198 17395 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.512315 17395 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.507661 17062 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
W20260201 08:59:20.501545 17175 leader_election.cc:343] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.514465 17175 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.514791 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:20.515339 17463 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.515802 17463 raft_consensus.cc:697] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:20.522662 17027 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:20.516605 17463 consensus_queue.cc:237] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.523814 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:20.524251 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.524485 17136 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.524930 17285 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:20.527279 17365 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:20.526849 17174 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:20.530475 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.546527 17462 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.547055 17462 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.537943 17103 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:20.547427 17462 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:20.547812 17101 leader_election.cc:343] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.548041 17449 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.549105 17449 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.549472 17449 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.551258 17337 consensus_queue.cc:1048] T 633da6e0243e4ed295549ef2f930e78d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.555887 17449 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.527449 17327 ts_tablet_manager.cc:1434] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.084s user 0.006s sys 0.001s
I20260201 08:59:20.558230 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:20.559639 17285 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.527313 17455 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.562218 17327 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:20.577051 17328 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:20.577464 17328 ts_tablet_manager.cc:1403] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.250s user 0.021s sys 0.005s
I20260201 08:59:20.575078 17455 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.580245 17455 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.586081 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:20.587152 17455 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.576767 17449 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:20.593345 17101 leader_election.cc:343] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.594503 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.595405 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.596100 17062 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.594003 17285 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:20.597295 17175 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:20.597987 17103 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:20.598591 17395 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.599080 17395 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:20.599465 17177 leader_election.cc:343] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.600973 17395 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:20.601532 17395 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.602138 17395 raft_consensus.cc:697] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:20.602784 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:20.602936 17395 consensus_queue.cc:237] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:20.604398 17102 leader_election.cc:343] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.604516 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.598479 17461 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.605520 17461 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.605849 17461 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:20.606088 17103 leader_election.cc:343] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.606530 17103 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.607756 17447 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:20.611606 17382 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.612602 17329 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.613121 17329 ts_tablet_manager.cc:1403] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.191s user 0.043s sys 0.048s
I20260201 08:59:20.613623 17382 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.615491 17329 raft_consensus.cc:359] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.616156 17329 raft_consensus.cc:385] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.616395 17329 raft_consensus.cc:740] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.617607 17462 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.618922 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:20.617902 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:20.620136 17329 consensus_queue.cc:260] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:20.621219 17103 leader_election.cc:343] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.620707 17062 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.625986 17329 ts_tablet_manager.cc:1434] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260201 08:59:20.627048 17329 tablet_bootstrap.cc:492] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.628818 17365 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.629491 17328 raft_consensus.cc:359] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.630198 17328 raft_consensus.cc:385] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.630460 17328 raft_consensus.cc:740] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.631083 17328 consensus_queue.cc:260] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.632431 17329 tablet_bootstrap.cc:654] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.633360 17062 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:20.644362 17365 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.648461 17101 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.649828 17395 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.650333 17395 raft_consensus.cc:697] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:20.651191 17395 consensus_queue.cc:237] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.658458 17439 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.662550 16955 catalog_manager.cc:5654] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
W20260201 08:59:20.664227 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:20.634930 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:20.669714 17175 leader_election.cc:343] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.636966 17332 tablet_bootstrap.cc:492] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:20.670893 17332 ts_tablet_manager.cc:1403] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.196s user 0.021s sys 0.010s
I20260201 08:59:20.673755 17332 raft_consensus.cc:359] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.639591 17463 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.678025 17332 raft_consensus.cc:385] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.678419 17332 raft_consensus.cc:740] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.678169 17463 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.679241 17332 consensus_queue.cc:260] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.680338 17463 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.639995 17461 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.681941 17332 ts_tablet_manager.cc:1434] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260201 08:59:20.684680 17332 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.685070 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:20.684525 17283 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.685652 17062 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.686122 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.687331 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:20.688752 17395 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.682173 17461 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.684439 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.689332 17395 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:20.690630 17175 leader_election.cc:343] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.634199 17462 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.665807 17327 tablet_bootstrap.cc:654] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.691363 17395 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.693965 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.696807 17332 tablet_bootstrap.cc:654] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.697129 17431 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.700037 17337 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.700388 17062 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.701572 17175 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:20.667085 16960 catalog_manager.cc:5654] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.638861 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:20.702802 17134 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.675246 17328 ts_tablet_manager.cc:1434] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.098s user 0.007s sys 0.000s
I20260201 08:59:20.705781 17328 tablet_bootstrap.cc:492] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:20.677186 17387 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.709137 17387 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.700507 17337 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:20.711082 17387 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.711243 17337 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:20.712675 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.712934 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:20.714123 17175 leader_election.cc:343] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:20.714419 17249 leader_election.cc:343] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:20.716213 17177 leader_election.cc:343] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.716691 17177 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.717386 17387 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.717936 17385 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:20.717971 17387 raft_consensus.cc:697] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:20.708470 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.721603 17103 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.721532 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.722466 17282 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:20.722932 17447 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:20.722941 17328 tablet_bootstrap.cc:654] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:20.717895 17177 leader_election.cc:343] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.726052 17177 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:20.735752 17463 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.736292 17463 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.736678 17463 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.719655 17387 consensus_queue.cc:237] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.742115 17134 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.743193 17174 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:20.744562 17462 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.745144 17462 raft_consensus.cc:697] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:20.746066 17462 consensus_queue.cc:237] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.752102 17327 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:20.752604 17327 ts_tablet_manager.cc:1403] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.191s user 0.013s sys 0.001s
I20260201 08:59:20.754735 17332 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:20.755234 17327 raft_consensus.cc:359] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.755278 17332 ts_tablet_manager.cc:1403] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.073s user 0.013s sys 0.021s
I20260201 08:59:20.758136 17329 tablet_bootstrap.cc:492] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.758689 17329 ts_tablet_manager.cc:1403] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.132s user 0.016s sys 0.039s
I20260201 08:59:20.760566 17328 tablet_bootstrap.cc:492] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:20.761101 17328 ts_tablet_manager.cc:1403] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.056s user 0.012s sys 0.000s
I20260201 08:59:20.761216 17329 raft_consensus.cc:359] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.761938 17329 raft_consensus.cc:385] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.762210 17329 raft_consensus.cc:740] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.755971 17327 raft_consensus.cc:385] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.763190 17327 raft_consensus.cc:740] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.763916 17327 consensus_queue.cc:260] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.765009 17329 consensus_queue.cc:260] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.767619 17329 ts_tablet_manager.cc:1434] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260201 08:59:20.768209 17327 ts_tablet_manager.cc:1434] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.015s user 0.004s sys 0.001s
I20260201 08:59:20.768680 17329 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.764600 17332 raft_consensus.cc:359] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.773569 17332 raft_consensus.cc:385] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.773874 17332 raft_consensus.cc:740] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.765712 17328 raft_consensus.cc:359] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.773962 17327 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:20.773258 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:20.774539 17332 consensus_queue.cc:260] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.777936 17332 ts_tablet_manager.cc:1434] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.022s user 0.003s sys 0.002s
I20260201 08:59:20.778911 17332 tablet_bootstrap.cc:492] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.779795 17387 consensus_queue.cc:1048] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.782375 17328 raft_consensus.cc:385] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.782675 17328 raft_consensus.cc:740] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.783383 17328 consensus_queue.cc:260] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.784415 17332 tablet_bootstrap.cc:654] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.785229 17329 tablet_bootstrap.cc:654] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.786006 17328 ts_tablet_manager.cc:1434] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
W20260201 08:59:20.786204 17248 leader_election.cc:343] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.786732 17327 tablet_bootstrap.cc:654] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.791739 17328 tablet_bootstrap.cc:492] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:20.788038 16958 catalog_manager.cc:5654] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.797071 17463 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.797932 17329 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.798431 17329 ts_tablet_manager.cc:1403] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.030s user 0.014s sys 0.002s
I20260201 08:59:20.799088 17463 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:20.799849 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:20.800480 17282 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.804113 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:20.804782 17062 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.809963 17328 tablet_bootstrap.cc:654] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.810679 17329 raft_consensus.cc:359] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.811473 17329 raft_consensus.cc:385] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.811765 17329 raft_consensus.cc:740] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.812671 17282 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.815670 17177 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:20.816520 17463 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:20.817015 17463 raft_consensus.cc:697] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:20.817559 17329 consensus_queue.cc:260] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.817783 17463 consensus_queue.cc:237] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.820370 17329 ts_tablet_manager.cc:1434] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260201 08:59:20.821452 17329 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.786672 17248 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:20.825484 17327 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:20.825289 17337 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:20.825944 17327 ts_tablet_manager.cc:1403] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.052s user 0.011s sys 0.002s
I20260201 08:59:20.828559 17327 raft_consensus.cc:359] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.829223 17327 raft_consensus.cc:385] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.829473 17327 raft_consensus.cc:740] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.830212 17327 consensus_queue.cc:260] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.831270 17329 tablet_bootstrap.cc:654] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.835536 17327 ts_tablet_manager.cc:1434] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
W20260201 08:59:20.839875 17103 consensus_peers.cc:597] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:20.841784 17062 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:20.849030 17461 consensus_queue.cc:1048] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.852447 16956 catalog_manager.cc:5654] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:20.862578 17461 consensus_queue.cc:1048] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:20.889997 17327 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:20.893913 17332 tablet_bootstrap.cc:492] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:20.894444 17332 ts_tablet_manager.cc:1403] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.116s user 0.024s sys 0.004s
I20260201 08:59:20.897459 17332 raft_consensus.cc:359] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.898283 17332 raft_consensus.cc:385] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.898547 17332 raft_consensus.cc:740] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.899250 17332 consensus_queue.cc:260] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.901466 17136 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.901749 17329 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:20.902328 17329 ts_tablet_manager.cc:1403] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.081s user 0.011s sys 0.000s
I20260201 08:59:20.909868 16958 catalog_manager.cc:5654] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:20.911415 17329 raft_consensus.cc:359] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.912194 17329 raft_consensus.cc:385] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.912468 17329 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.912493 17332 ts_tablet_manager.cc:1434] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260201 08:59:20.913763 17332 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:20.914389 16958 catalog_manager.cc:5654] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:20.913273 17329 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:20.918190 17328 tablet_bootstrap.cc:492] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:20.918591 17328 ts_tablet_manager.cc:1403] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.127s user 0.007s sys 0.008s
I20260201 08:59:20.921365 17328 raft_consensus.cc:359] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.922191 17328 raft_consensus.cc:385] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.922452 17328 raft_consensus.cc:740] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:20.923168 17328 consensus_queue.cc:260] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.925675 17329 ts_tablet_manager.cc:1434] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20260201 08:59:20.926784 17329 tablet_bootstrap.cc:492] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:20.927629 17327 tablet_bootstrap.cc:654] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.932269 17329 tablet_bootstrap.cc:654] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.937906 17462 consensus_queue.cc:1048] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.943181 17332 tablet_bootstrap.cc:654] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.958652 17328 ts_tablet_manager.cc:1434] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.040s user 0.005s sys 0.002s
I20260201 08:59:20.963462 17447 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.964076 17328 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:20.966643 17382 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.967228 17382 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.970438 17382 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.970579 17431 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:20.971051 17431 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.971952 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:20.972581 17061 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:20.973364 17431 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:20.974067 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:20.964125 17447 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:20.975749 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:20.976320 17447 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:20.976384 17134 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:20.977205 17328 tablet_bootstrap.cc:654] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.977780 17025 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:20.978489 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:20.979503 17101 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:20.980286 17343 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.980645 17343 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.980758 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:20.981016 17343 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:20.981207 17327 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:20.981755 17327 ts_tablet_manager.cc:1403] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.145s user 0.026s sys 0.012s
W20260201 08:59:20.982103 17027 leader_election.cc:343] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.984225 17327 raft_consensus.cc:359] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.984848 17327 raft_consensus.cc:385] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:20.985139 17327 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
W20260201 08:59:20.985461 17103 leader_election.cc:343] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:20.985565 17177 consensus_peers.cc:597] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:20.985806 17327 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.987917 17327 ts_tablet_manager.cc:1434] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:59:20.989095 17327 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:20.990963 17343 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:20.992296 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:20.992980 17209 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:20.993909 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:20.994478 17136 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:20.994598 17102 leader_election.cc:343] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:20.994822 17327 tablet_bootstrap.cc:654] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:20.995625 17102 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:20.996905 17449 consensus_queue.cc:1048] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:20.998186 17449 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:20.998493 17449 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:20.999065 17449 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.002872 17136 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:21.003460 17352 raft_consensus.cc:2764] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260201 08:59:21.006901 17025 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:21.007673 17439 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.008127 17439 raft_consensus.cc:697] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:21.008942 17439 consensus_queue.cc:237] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.010495 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:21.012171 17027 leader_election.cc:343] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.012382 17332 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:21.012912 17332 ts_tablet_manager.cc:1403] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.099s user 0.006s sys 0.020s
I20260201 08:59:21.014842 17343 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:21.017659 17462 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.018151 17462 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.019192 17387 consensus_queue.cc:1048] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.020071 17462 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.022081 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:21.027266 17177 leader_election.cc:343] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.029280 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:21.030522 17174 leader_election.cc:343] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.030948 17174 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.034152 17462 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.036981 16956 catalog_manager.cc:5654] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:21.037896 17449 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.041491 17329 tablet_bootstrap.cc:492] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:21.041980 17329 ts_tablet_manager.cc:1403] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.115s user 0.005s sys 0.007s
I20260201 08:59:21.042169 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:21.042804 17210 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.045437 17352 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.054695 17352 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.055475 17329 raft_consensus.cc:359] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.056176 17329 raft_consensus.cc:385] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.057314 17329 raft_consensus.cc:740] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.057960 17329 consensus_queue.cc:260] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.060074 17329 ts_tablet_manager.cc:1434] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20260201 08:59:21.061159 17329 tablet_bootstrap.cc:492] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:21.062574 17352 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.063472 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.065393 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.066401 17439 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:21.067880 17103 leader_election.cc:343] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.068252 17439 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:21.069233 17102 leader_election.cc:343] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.070904 17439 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.071099 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.071815 17208 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:21.069797 17102 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.074563 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.075793 17027 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:21.076354 17028 leader_election.cc:343] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.077805 17439 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:21.078225 17439 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:21.078547 17439 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.080547 17352 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.083647 17332 raft_consensus.cc:359] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.086218 17332 raft_consensus.cc:385] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.086524 17332 raft_consensus.cc:740] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.087283 17332 consensus_queue.cc:260] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.093261 17332 ts_tablet_manager.cc:1434] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.080s user 0.004s sys 0.002s
I20260201 08:59:21.094228 17332 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:21.100749 17210 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:21.112454 17102 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:21.113637 17352 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.114616 17352 raft_consensus.cc:697] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:21.115550 17352 consensus_queue.cc:237] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.120481 17332 tablet_bootstrap.cc:654] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.135183 17332 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:21.135663 17332 ts_tablet_manager.cc:1403] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.042s user 0.009s sys 0.000s
I20260201 08:59:21.138082 17332 raft_consensus.cc:359] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.138758 17332 raft_consensus.cc:385] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.139014 17332 raft_consensus.cc:740] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.139611 17332 consensus_queue.cc:260] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.147240 17462 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.151113 17449 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.110570 17329 tablet_bootstrap.cc:654] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.165342 17365 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.165896 17365 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.168279 17365 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:21.174167 17439 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.177147 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:21.177826 17209 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.181717 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.186498 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.186205 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:21.187260 17133 raft_consensus.cc:2393] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 1: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:21.188493 17025 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:21.189597 17365 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.189890 17447 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.190347 17447 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.192212 17447 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.194810 17447 consensus_queue.cc:1048] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.194921 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.195231 17433 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.195689 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.195729 17433 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:21.197028 17101 leader_election.cc:343] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:21.197364 17103 leader_election.cc:343] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.197778 17365 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.195644 17282 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:21.199214 17433 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:21.202354 17103 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:21.203881 17177 consensus_peers.cc:597] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:21.204339 17449 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:21.204682 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.204840 17449 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:21.205518 17449 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:21.206579 17248 leader_election.cc:343] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:21.207526 17103 consensus_peers.cc:597] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:21.208627 17462 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.205013 17352 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260201 08:59:21.209132 17462 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.212057 17462 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.212932 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.213860 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:21.214195 17101 consensus_peers.cc:597] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:21.214521 17210 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
W20260201 08:59:21.214582 17175 leader_election.cc:343] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.215322 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.215662 17250 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:21.217083 17433 raft_consensus.cc:2804] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:21.217449 17433 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:21.217784 17433 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:21.222375 17177 leader_election.cc:343] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.222929 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.224177 17337 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.224645 17337 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.225077 17455 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.226758 17337 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:21.227895 17433 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.229893 17433 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:21.232709 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.232975 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:21.233505 17208 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.219823 16956 catalog_manager.cc:5654] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:21.217638 17332 ts_tablet_manager.cc:1434] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.082s user 0.007s sys 0.000s
I20260201 08:59:21.238946 17332 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:21.244342 17332 tablet_bootstrap.cc:654] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.247248 17208 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:21.248498 17250 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:21.249455 17433 raft_consensus.cc:2804] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.250177 17433 raft_consensus.cc:697] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:21.251411 17433 consensus_queue.cc:237] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.253767 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.254408 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:21.255448 17248 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:21.256428 17337 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:21.257262 17248 leader_election.cc:343] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.265280 17332 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:21.265903 17332 ts_tablet_manager.cc:1403] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.007s
I20260201 08:59:21.268573 17332 raft_consensus.cc:359] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.269323 17332 raft_consensus.cc:385] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.269610 17332 raft_consensus.cc:740] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.202314 17209 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:21.271765 17329 tablet_bootstrap.cc:492] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:21.271641 17027 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:21.272614 17365 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.273132 17365 raft_consensus.cc:697] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:21.272989 17332 consensus_queue.cc:260] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.274008 17365 consensus_queue.cc:237] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.275146 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:21.276484 17028 leader_election.cc:343] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.277590 17439 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.277688 17332 ts_tablet_manager.cc:1434] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260201 08:59:21.278570 17329 ts_tablet_manager.cc:1403] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.218s user 0.011s sys 0.000s
I20260201 08:59:21.281021 17462 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.295974 17332 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:21.297490 17329 raft_consensus.cc:359] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.298445 17329 raft_consensus.cc:385] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.298707 17329 raft_consensus.cc:740] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.299258 17329 consensus_queue.cc:260] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.302191 17387 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.302690 17387 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.304644 17387 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:21.309408 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.310490 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:21.311126 17175 leader_election.cc:343] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:21.312844 17174 leader_election.cc:343] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.313362 17462 consensus_queue.cc:1048] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.313357 17174 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:21.315742 17329 ts_tablet_manager.cc:1434] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.037s user 0.004s sys 0.002s
I20260201 08:59:21.315910 17385 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.320794 17329 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:21.337448 17332 tablet_bootstrap.cc:654] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.338128 17387 consensus_queue.cc:1048] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.337368 17327 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:21.340545 17327 ts_tablet_manager.cc:1403] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.352s user 0.083s sys 0.162s
I20260201 08:59:21.346616 17327 raft_consensus.cc:359] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.349408 16958 catalog_manager.cc:5654] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:21.356499 17327 raft_consensus.cc:385] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.356940 17327 raft_consensus.cc:740] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.358748 17327 consensus_queue.cc:260] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.345525 17449 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.361433 17329 tablet_bootstrap.cc:654] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.345443 17328 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:21.362522 17462 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.363173 17328 ts_tablet_manager.cc:1403] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.399s user 0.078s sys 0.102s
I20260201 08:59:21.363112 17462 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.365129 17455 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.366101 17328 raft_consensus.cc:359] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.366804 17328 raft_consensus.cc:385] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.367560 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:21.368376 17282 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.368968 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.369252 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:21.370539 17101 leader_election.cc:343] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:21.370640 17177 leader_election.cc:343] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.371127 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.371767 17134 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:21.367632 17462 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.373485 17449 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.373561 17174 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.374655 17327 ts_tablet_manager.cc:1434] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.034s user 0.006s sys 0.001s
I20260201 08:59:21.378567 17327 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:21.382879 17387 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:21.383399 17387 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:21.383819 17387 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.396248 16955 catalog_manager.cc:5654] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:21.367081 17328 raft_consensus.cc:740] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.408385 17328 consensus_queue.cc:260] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.413945 17327 tablet_bootstrap.cc:654] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.417462 17328 ts_tablet_manager.cc:1434] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20260201 08:59:21.418489 17328 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
W20260201 08:59:21.421324 17027 consensus_peers.cc:597] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f -> Peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Couldn't send request to peer f5398ba4a58b40ca9b78a210cdb7ae4d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:21.421654 17329 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:21.422111 17329 ts_tablet_manager.cc:1403] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.102s user 0.009s sys 0.003s
I20260201 08:59:21.424291 17329 raft_consensus.cc:359] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.424778 17329 raft_consensus.cc:385] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.425051 17329 raft_consensus.cc:740] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.425746 17329 consensus_queue.cc:260] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.426535 17387 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.427924 17329 ts_tablet_manager.cc:1434] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260201 08:59:21.432271 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:21.432931 17136 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.433667 17387 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.429958 17332 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:21.434608 17332 ts_tablet_manager.cc:1403] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.148s user 0.010s sys 0.008s
I20260201 08:59:21.433010 17329 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:21.437206 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:21.438606 17285 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:21.438712 17177 leader_election.cc:343] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.440160 17136 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:21.441169 17174 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.441505 17332 raft_consensus.cc:359] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.383999 17282 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:21.441943 17387 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.444411 17329 tablet_bootstrap.cc:654] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.445230 17387 raft_consensus.cc:697] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:21.444713 17332 raft_consensus.cc:385] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.445752 17332 raft_consensus.cc:740] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.446161 17387 consensus_queue.cc:237] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.446468 17332 consensus_queue.cc:260] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.448745 17332 ts_tablet_manager.cc:1434] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260201 08:59:21.451509 17332 tablet_bootstrap.cc:492] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:21.452312 17103 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:21.428342 17328 tablet_bootstrap.cc:654] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.453446 17449 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.453958 17449 raft_consensus.cc:697] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:21.454748 17449 consensus_queue.cc:237] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.462337 17332 tablet_bootstrap.cc:654] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.462889 17327 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:21.466662 17449 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.474231 17329 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:21.468304 17327 ts_tablet_manager.cc:1403] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.090s user 0.012s sys 0.000s
I20260201 08:59:21.475775 17329 ts_tablet_manager.cc:1403] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.043s user 0.010s sys 0.005s
I20260201 08:59:21.476073 17332 tablet_bootstrap.cc:492] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:21.476521 17332 ts_tablet_manager.cc:1403] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.001s
I20260201 08:59:21.477795 17327 raft_consensus.cc:359] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.478487 17327 raft_consensus.cc:385] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.478749 17327 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.478854 17332 raft_consensus.cc:359] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.478646 17329 raft_consensus.cc:359] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.479741 17332 raft_consensus.cc:385] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.479823 17329 raft_consensus.cc:385] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.480122 17332 raft_consensus.cc:740] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.479776 17327 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.480454 17329 raft_consensus.cc:740] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.481740 17329 consensus_queue.cc:260] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.468259 17449 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.485512 17329 ts_tablet_manager.cc:1434] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260201 08:59:21.487787 17329 tablet_bootstrap.cc:492] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:21.488960 16957 catalog_manager.cc:5654] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:21.489153 17332 consensus_queue.cc:260] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.489889 17327 ts_tablet_manager.cc:1434] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20260201 08:59:21.491852 17332 ts_tablet_manager.cc:1434] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.015s user 0.001s sys 0.005s
I20260201 08:59:21.492849 17332 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:21.498564 17449 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.498798 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.492699 16958 catalog_manager.cc:5654] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:21.495543 17327 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:21.496798 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:21.502656 17103 leader_election.cc:343] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.502677 17387 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.504055 17387 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:21.505970 17101 leader_election.cc:343] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.508342 17101 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.509826 17327 tablet_bootstrap.cc:654] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.510799 17449 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.511668 17329 tablet_bootstrap.cc:654] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.512209 17332 tablet_bootstrap.cc:654] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.516661 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.509523 17455 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.517869 17455 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.518774 17387 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:21.519706 17455 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.520190 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.522778 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:21.528283 17175 leader_election.cc:343] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.530731 17136 raft_consensus.cc:2393] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 1: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:21.534101 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:21.535436 17177 leader_election.cc:343] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.535866 17177 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.536593 17462 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.536752 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:21.538511 17462 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.542747 17328 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:21.543256 17328 ts_tablet_manager.cc:1403] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.125s user 0.013s sys 0.010s
I20260201 08:59:21.546337 17328 raft_consensus.cc:359] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.547559 17328 raft_consensus.cc:385] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.547879 17328 raft_consensus.cc:740] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.548650 17328 consensus_queue.cc:260] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.551214 17462 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.553851 17449 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.554368 17449 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.554872 17329 tablet_bootstrap.cc:492] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:21.555438 17329 ts_tablet_manager.cc:1403] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.068s user 0.011s sys 0.001s
I20260201 08:59:21.556350 17449 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:21.557312 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.558667 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:21.559235 17101 leader_election.cc:343] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:21.560578 17102 leader_election.cc:343] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.561087 17102 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:21.561585 17328 ts_tablet_manager.cc:1434] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260201 08:59:21.562676 17382 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.565557 17365 consensus_queue.cc:1048] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:21.567154 17365 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.562878 17328 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:21.568820 17332 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:21.569362 17332 ts_tablet_manager.cc:1403] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.077s user 0.016s sys 0.003s
I20260201 08:59:21.569957 17327 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:21.570413 17327 ts_tablet_manager.cc:1403] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.075s user 0.016s sys 0.001s
I20260201 08:59:21.571836 17332 raft_consensus.cc:359] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.572500 17332 raft_consensus.cc:385] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.562676 17329 raft_consensus.cc:359] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.573442 17329 raft_consensus.cc:385] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.573714 17329 raft_consensus.cc:740] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.574251 17328 tablet_bootstrap.cc:654] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.574429 17329 consensus_queue.cc:260] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.580448 17329 ts_tablet_manager.cc:1434] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260201 08:59:21.580983 17449 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.581506 17329 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:21.581513 17449 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.584367 17449 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.585969 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.572770 17327 raft_consensus.cc:359] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.586927 17327 raft_consensus.cc:385] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.587194 17327 raft_consensus.cc:740] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.572793 17332 raft_consensus.cc:740] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.587857 17327 consensus_queue.cc:260] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.588121 17332 consensus_queue.cc:260] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.588891 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.567624 17365 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.590196 17061 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:21.590492 17332 ts_tablet_manager.cc:1434] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260201 08:59:21.591823 17332 tablet_bootstrap.cc:492] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:21.592577 17329 tablet_bootstrap.cc:654] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.592952 17101 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:21.593806 17449 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:21.590251 17327 ts_tablet_manager.cc:1434] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260201 08:59:21.594149 17449 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:21.594581 17449 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.595137 17327 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:21.596056 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.596870 17365 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:21.597587 17103 leader_election.cc:343] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.598737 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:21.600164 17028 leader_election.cc:343] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.601987 17327 tablet_bootstrap.cc:654] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.602073 17449 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.603256 17134 raft_consensus.cc:2393] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 1: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:21.605091 17025 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.606249 17365 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.609853 17327 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:21.610339 17327 ts_tablet_manager.cc:1403] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.000s
I20260201 08:59:21.614687 17365 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.615417 17337 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.615716 17329 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:21.616024 17337 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.616551 17462 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.617118 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:21.617065 17462 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.618091 17337 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:21.618477 17103 leader_election.cc:343] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.618954 17462 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.620532 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.620954 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:21.621016 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.621054 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.621618 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.621857 17134 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:21.622570 17449 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.623257 17249 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:21.623279 17174 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:21.616225 17329 ts_tablet_manager.cc:1403] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.035s user 0.013s sys 0.000s
I20260201 08:59:21.625425 17462 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:21.625877 17462 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:21.626211 17462 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.627396 17329 raft_consensus.cc:359] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.628113 17329 raft_consensus.cc:385] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.628372 17329 raft_consensus.cc:740] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
W20260201 08:59:21.630426 17177 leader_election.cc:343] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.634426 17332 tablet_bootstrap.cc:654] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.629040 17337 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.629135 17329 consensus_queue.cc:260] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.635224 17462 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.641069 17329 ts_tablet_manager.cc:1434] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.016s user 0.005s sys 0.002s
I20260201 08:59:21.642139 17329 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:21.624703 17327 raft_consensus.cc:359] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.643211 17327 raft_consensus.cc:385] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.643462 17327 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.643615 17060 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:21.644224 17327 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.646396 17327 ts_tablet_manager.cc:1434] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20260201 08:59:21.647398 17462 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.648423 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:21.649184 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:21.649775 17134 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:21.649899 17177 leader_election.cc:343] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.654093 17337 consensus_queue.cc:1048] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.654930 17328 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:21.655393 17328 ts_tablet_manager.cc:1403] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.093s user 0.013s sys 0.017s
I20260201 08:59:21.657953 17328 raft_consensus.cc:359] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.658556 17328 raft_consensus.cc:385] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.658804 17328 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.660372 17328 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.647271 17327 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:21.666091 17328 ts_tablet_manager.cc:1434] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260201 08:59:21.664499 17134 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:21.667128 17328 tablet_bootstrap.cc:492] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:21.667372 17174 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.668594 17462 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.669124 17462 raft_consensus.cc:697] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:21.670163 17329 tablet_bootstrap.cc:654] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.669910 17462 consensus_queue.cc:237] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.693768 17327 tablet_bootstrap.cc:654] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.695254 17101 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.696508 17382 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:21.697095 17382 raft_consensus.cc:697] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:21.698045 17447 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.697923 17382 consensus_queue.cc:237] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.698555 17447 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.700615 17447 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.701701 17328 tablet_bootstrap.cc:654] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.702358 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.702518 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.706055 17102 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.707125 17449 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.707860 17447 consensus_queue.cc:1048] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 08:59:21.718366 17103 consensus_peers.cc:597] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:21.731758 17328 tablet_bootstrap.cc:492] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:21.732342 17328 ts_tablet_manager.cc:1403] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.065s user 0.018s sys 0.018s
I20260201 08:59:21.733229 17329 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:21.733783 17329 ts_tablet_manager.cc:1403] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.092s user 0.015s sys 0.000s
I20260201 08:59:21.734923 17328 raft_consensus.cc:359] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.735690 17328 raft_consensus.cc:385] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.735950 17328 raft_consensus.cc:740] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.738382 17329 raft_consensus.cc:359] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.739078 17329 raft_consensus.cc:385] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.739336 17329 raft_consensus.cc:740] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.740609 17329 consensus_queue.cc:260] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.736691 17328 consensus_queue.cc:260] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.745421 17328 ts_tablet_manager.cc:1434] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.013s user 0.005s sys 0.004s
I20260201 08:59:21.755602 17337 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.756178 17337 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.758209 17337 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.760092 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.753700 17328 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:21.760820 17531 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.760069 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.761315 17531 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.765537 17531 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:21.766647 17250 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:21.767315 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.768271 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:21.769215 17337 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.771456 17134 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.773168 17250 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:21.774842 17433 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.778393 17332 tablet_bootstrap.cc:492] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:21.778891 17332 ts_tablet_manager.cc:1403] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.187s user 0.012s sys 0.000s
I20260201 08:59:21.780546 17343 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.781059 17343 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.782908 17343 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:21.784592 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.786104 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.786585 17328 tablet_bootstrap.cc:654] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.787053 17332 raft_consensus.cc:359] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.787691 17028 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.787716 17332 raft_consensus.cc:385] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.789235 17332 raft_consensus.cc:740] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.789939 17343 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:21.790587 17332 consensus_queue.cc:260] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:21.791828 17329 ts_tablet_manager.cc:1434] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.058s user 0.006s sys 0.000s
I20260201 08:59:21.801232 17332 ts_tablet_manager.cc:1434] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.022s user 0.009s sys 0.000s
I20260201 08:59:21.795112 17060 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.807834 17332 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:21.813318 17329 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:21.815027 16956 catalog_manager.cc:5654] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:21.813586 17439 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260201 08:59:21.824054 17327 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:21.824561 17327 ts_tablet_manager.cc:1403] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.177s user 0.015s sys 0.016s
I20260201 08:59:21.829385 16957 catalog_manager.cc:5654] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:21.830631 17531 consensus_queue.cc:1048] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.855389 17282 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.856330 17328 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:21.856841 17328 ts_tablet_manager.cc:1403] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.103s user 0.016s sys 0.003s
I20260201 08:59:21.859380 17328 raft_consensus.cc:359] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.860080 17328 raft_consensus.cc:385] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.860347 17328 raft_consensus.cc:740] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.873776 17387 consensus_queue.cc:1048] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.872387 17327 raft_consensus.cc:359] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.877306 17327 raft_consensus.cc:385] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:21.877655 17327 raft_consensus.cc:740] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:21.878355 17327 consensus_queue.cc:260] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.879925 17328 consensus_queue.cc:260] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.887941 17285 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.892017 17343 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.899525 17328 ts_tablet_manager.cc:1434] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260201 08:59:21.906252 17327 ts_tablet_manager.cc:1434] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.081s user 0.009s sys 0.000s
I20260201 08:59:21.892611 17343 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:21.906359 17439 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.911644 17439 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:21.912714 17343 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:21.913573 17439 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:21.915102 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.915736 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.920771 17327 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:21.923635 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:21.935292 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:21.936012 17211 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:21.936570 17332 tablet_bootstrap.cc:654] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:21.930877 17284 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 1: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
W20260201 08:59:21.941872 17028 leader_election.cc:343] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:21.958590 17028 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:21.959461 17365 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.959915 17462 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:21.960435 17462 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:21.962368 17462 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:21.964047 17328 tablet_bootstrap.cc:492] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:21.969152 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:21.969863 17133 raft_consensus.cc:2468] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:21.971294 17174 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:21.972391 17387 raft_consensus.cc:2804] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:21.972788 17387 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:21.973148 17387 raft_consensus.cc:3060] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:21.980625 17449 consensus_queue.cc:1048] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:21.952476 17343 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260201 08:59:22.009630 17327 tablet_bootstrap.cc:654] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:22.013368 17558 log.cc:927] Time spent T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.081s user 0.001s sys 0.000s
W20260201 08:59:22.025444 17556 log.cc:927] Time spent T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
I20260201 08:59:22.026677 17449 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.027232 17449 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.029184 17449 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.030246 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:22.030993 17059 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:22.004703 17462 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.031108 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.031838 17210 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:22.031643 17462 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.033191 17102 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:22.033720 17462 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:22.034483 17382 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:22.034902 17382 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:22.035236 17382 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.037818 17365 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:22.038982 17027 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.040588 17439 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:22.040932 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:22.042641 17329 tablet_bootstrap.cc:654] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.045543 17387 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.047667 17387 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:22.048606 17174 leader_election.cc:343] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.051893 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:22.052510 17134 raft_consensus.cc:3060] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.053843 17449 consensus_queue.cc:1048] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:22.054983 17382 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.040957 17439 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:22.055958 17439 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.061452 17332 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:22.061852 17134 raft_consensus.cc:2468] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:22.062155 17332 ts_tablet_manager.cc:1403] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.256s user 0.022s sys 0.012s
I20260201 08:59:22.073261 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:22.066753 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:22.064764 17332 raft_consensus.cc:359] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.084960 17332 raft_consensus.cc:385] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.075591 17328 tablet_bootstrap.cc:654] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.085325 17332 raft_consensus.cc:740] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.089912 17332 consensus_queue.cc:260] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.083379 17462 consensus_queue.cc:1048] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260201 08:59:22.097623 17174 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:22.097747 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:22.098868 17455 raft_consensus.cc:2804] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.099357 17455 raft_consensus.cc:697] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:22.100191 17455 consensus_queue.cc:237] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:22.105226 17175 leader_election.cc:343] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.105743 17175 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:22.105918 17285 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.107128 17387 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:22.111737 17103 consensus_peers.cc:597] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:22.128827 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:22.129572 17059 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.067123 17439 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:22.142262 17332 ts_tablet_manager.cc:1434] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.080s user 0.006s sys 0.000s
I20260201 08:59:22.149521 17382 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.152474 17449 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:22.152325 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 47140.1us
I20260201 08:59:22.155685 17332 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
W20260201 08:59:22.162356 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:22.167053 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:22.170215 17284 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.168442 17209 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:22.175447 17175 leader_election.cc:343] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:22.184527 17175 leader_election.cc:343] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:22.184986 17177 consensus_peers.cc:597] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:22.184561 17439 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:22.187251 17447 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.187757 17447 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.189719 17447 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:22.167937 17449 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.194857 17449 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.199610 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:22.201334 17101 leader_election.cc:343] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.201879 17059 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:22.203145 17101 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:22.204208 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:22.204414 17395 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.205076 17395 raft_consensus.cc:697] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:22.207198 17395 consensus_queue.cc:237] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.216233 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.216993 17208 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
W20260201 08:59:22.217649 17103 leader_election.cc:343] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.218348 17327 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:22.218348 17102 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:22.218989 17327 ts_tablet_manager.cc:1403] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.302s user 0.025s sys 0.005s
I20260201 08:59:22.220050 17449 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:22.220440 17449 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:22.220750 17449 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.221701 17327 raft_consensus.cc:359] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.222596 17327 raft_consensus.cc:385] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.222921 17327 raft_consensus.cc:740] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.224730 17327 consensus_queue.cc:260] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.227089 17327 ts_tablet_manager.cc:1434] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260201 08:59:22.228093 17327 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:22.216233 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.245373 17210 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:22.246742 17102 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.247887 17352 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:22.248278 17352 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:22.248593 17352 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.251628 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:22.252274 17207 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.230031 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:22.255685 17352 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.231139 17449 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.235267 17332 tablet_bootstrap.cc:654] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.239059 17281 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:22.241331 17177 consensus_peers.cc:597] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:22.259653 17329 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:22.260154 17329 ts_tablet_manager.cc:1403] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.460s user 0.025s sys 0.024s
I20260201 08:59:22.261336 17207 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
W20260201 08:59:22.262156 17028 leader_election.cc:343] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.244844 17209 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:22.262821 17329 raft_consensus.cc:359] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.263561 17329 raft_consensus.cc:385] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.263831 17329 raft_consensus.cc:740] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.264014 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:22.265312 17101 leader_election.cc:343] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.264504 17329 consensus_queue.cc:260] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.283064 17329 ts_tablet_manager.cc:1434] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.023s user 0.003s sys 0.004s
I20260201 08:59:22.283406 17327 tablet_bootstrap.cc:654] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.284046 17449 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.292963 17329 tablet_bootstrap.cc:492] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:22.293447 17352 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:22.293437 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:22.298178 17210 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.303184 17328 tablet_bootstrap.cc:492] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:22.303650 17328 ts_tablet_manager.cc:1403] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.358s user 0.013s sys 0.020s
I20260201 08:59:22.301258 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:22.306275 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:22.306797 17027 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:22.307674 17103 leader_election.cc:343] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.306838 17209 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.309114 17365 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.309613 17365 raft_consensus.cc:697] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:22.310420 17365 consensus_queue.cc:237] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:22.318967 17447 consensus_queue.cc:1048] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:22.316502 17328 raft_consensus.cc:359] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.321671 17328 raft_consensus.cc:385] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.321983 17328 raft_consensus.cc:740] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.322919 17328 consensus_queue.cc:260] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.320634 16957 catalog_manager.cc:5654] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:22.330233 17329 tablet_bootstrap.cc:654] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.330840 17328 ts_tablet_manager.cc:1434] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.027s user 0.005s sys 0.001s
I20260201 08:59:22.332080 17328 tablet_bootstrap.cc:492] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:22.343828 17332 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:22.344398 17332 ts_tablet_manager.cc:1403] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.191s user 0.009s sys 0.009s
I20260201 08:59:22.347038 17332 raft_consensus.cc:359] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.347754 17332 raft_consensus.cc:385] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.348023 17332 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.325523 17209 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:22.353914 17210 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:22.354111 17102 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.355933 17328 tablet_bootstrap.cc:654] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.356163 17382 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.356666 17382 raft_consensus.cc:697] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:22.357512 17382 consensus_queue.cc:237] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.361763 17102 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:22.364243 17447 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.364733 17447 raft_consensus.cc:697] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:22.365571 17447 consensus_queue.cc:237] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.348637 17332 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.371640 17332 ts_tablet_manager.cc:1434] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.027s user 0.005s sys 0.002s
I20260201 08:59:22.372718 17332 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:22.379827 17332 tablet_bootstrap.cc:654] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.396719 16956 catalog_manager.cc:5654] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:22.451109 17329 tablet_bootstrap.cc:492] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:22.451579 17329 ts_tablet_manager.cc:1403] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.159s user 0.016s sys 0.008s
I20260201 08:59:22.454185 17328 tablet_bootstrap.cc:492] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:22.454017 17329 raft_consensus.cc:359] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.454784 17328 ts_tablet_manager.cc:1403] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.123s user 0.028s sys 0.009s
I20260201 08:59:22.455588 17329 raft_consensus.cc:385] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.457114 17327 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:22.458048 17327 ts_tablet_manager.cc:1403] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.230s user 0.017s sys 0.015s
I20260201 08:59:22.458400 16957 catalog_manager.cc:5654] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:22.464970 17327 raft_consensus.cc:359] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.465749 17327 raft_consensus.cc:385] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.466029 17327 raft_consensus.cc:740] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.458626 17329 raft_consensus.cc:740] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.467087 17329 consensus_queue.cc:260] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.468273 17327 consensus_queue.cc:260] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.476339 17327 ts_tablet_manager.cc:1434] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260201 08:59:22.477384 17327 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:22.474272 17329 ts_tablet_manager.cc:1434] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20260201 08:59:22.480125 17329 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:22.480640 17281 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.482578 16956 catalog_manager.cc:5654] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:22.484186 16956 catalog_manager.cc:5654] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:22.493592 17328 raft_consensus.cc:359] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.494345 17328 raft_consensus.cc:385] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.494474 17329 tablet_bootstrap.cc:654] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.501756 17327 tablet_bootstrap.cc:654] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.504940 17328 raft_consensus.cc:740] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.505748 17328 consensus_queue.cc:260] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.507786 17328 ts_tablet_manager.cc:1434] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.050s user 0.004s sys 0.000s
I20260201 08:59:22.508723 17328 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:22.514472 17328 tablet_bootstrap.cc:654] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.520239 17332 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:22.520723 17332 ts_tablet_manager.cc:1403] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.148s user 0.011s sys 0.007s
I20260201 08:59:22.522516 17327 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:22.522997 17327 ts_tablet_manager.cc:1403] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.046s user 0.013s sys 0.000s
I20260201 08:59:22.523486 17329 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:22.523970 17329 ts_tablet_manager.cc:1403] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.044s user 0.010s sys 0.003s
I20260201 08:59:22.523813 17332 raft_consensus.cc:359] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.524641 17332 raft_consensus.cc:385] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.524991 17332 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.525652 17332 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.526526 17329 raft_consensus.cc:359] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:22.527204 17329 raft_consensus.cc:385] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.527459 17329 raft_consensus.cc:740] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.528273 17332 ts_tablet_manager.cc:1434] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260201 08:59:22.528133 17329 consensus_queue.cc:260] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:22.529500 17332 tablet_bootstrap.cc:492] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:22.533079 17329 ts_tablet_manager.cc:1434] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260201 08:59:22.535564 17327 raft_consensus.cc:359] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.536268 17327 raft_consensus.cc:385] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.536525 17327 raft_consensus.cc:740] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.537128 17327 consensus_queue.cc:260] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.539255 17327 ts_tablet_manager.cc:1434] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260201 08:59:22.540180 17329 tablet_bootstrap.cc:492] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:22.546818 17329 tablet_bootstrap.cc:654] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.540907 17327 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:22.550695 17328 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:22.551208 17328 ts_tablet_manager.cc:1403] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.043s user 0.009s sys 0.000s
I20260201 08:59:22.553747 17328 raft_consensus.cc:359] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.554404 17328 raft_consensus.cc:385] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.554648 17328 raft_consensus.cc:740] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.556989 17327 tablet_bootstrap.cc:654] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.558182 17332 tablet_bootstrap.cc:654] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.555192 17328 consensus_queue.cc:260] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.565631 17328 ts_tablet_manager.cc:1434] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260201 08:59:22.569320 17328 tablet_bootstrap.cc:492] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:22.574829 17328 tablet_bootstrap.cc:654] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.577855 17332 tablet_bootstrap.cc:492] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:22.579427 17332 ts_tablet_manager.cc:1403] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.050s user 0.010s sys 0.001s
I20260201 08:59:22.581871 17332 raft_consensus.cc:359] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.584336 17329 tablet_bootstrap.cc:492] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:22.584831 17329 ts_tablet_manager.cc:1403] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.000s
I20260201 08:59:22.587296 17329 raft_consensus.cc:359] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.587597 17061 raft_consensus.cc:3060] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.587934 17329 raft_consensus.cc:385] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.588209 17329 raft_consensus.cc:740] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.588809 17329 consensus_queue.cc:260] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.582515 17332 raft_consensus.cc:385] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.589741 17332 raft_consensus.cc:740] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.590426 17332 consensus_queue.cc:260] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.587633 17563 consensus_queue.cc:1048] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260201 08:59:22.603502 17329 ts_tablet_manager.cc:1434] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.018s user 0.004s sys 0.001s
I20260201 08:59:22.604976 17447 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:22.607224 17329 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:22.608798 17332 ts_tablet_manager.cc:1434] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260201 08:59:22.610464 17439 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.611580 17563 consensus_queue.cc:1048] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:22.619689 17439 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.623026 17327 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:22.623549 17327 ts_tablet_manager.cc:1403] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.083s user 0.013s sys 0.000s
I20260201 08:59:22.626000 17327 raft_consensus.cc:359] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.626616 17327 raft_consensus.cc:385] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.626914 17327 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.630681 17447 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.631454 17439 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.631188 17447 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.629115 17327 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.632354 17387 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.632884 17387 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.633245 17447 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.634722 17387 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:22.635627 17332 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:22.636700 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:22.641036 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:22.641233 17101 leader_election.cc:343] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.643070 17447 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.643373 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:22.643661 17447 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.644614 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.644703 17134 raft_consensus.cc:2468] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:22.645808 17447 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:22.646854 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:22.647431 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:22.648383 17177 leader_election.cc:343] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:22.648921 17103 leader_election.cc:343] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:22.649627 17102 leader_election.cc:343] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.649758 17174 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.650138 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:22.652710 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.658572 17027 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:22.655380 17447 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:22.662763 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.656445 17387 raft_consensus.cc:2804] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:22.663894 17387 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:22.664228 17387 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.667718 17447 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:22.672267 17327 ts_tablet_manager.cc:1434] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.048s user 0.006s sys 0.000s
I20260201 08:59:22.673369 17327 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:22.683874 17329 tablet_bootstrap.cc:654] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.688457 17285 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.693574 17332 tablet_bootstrap.cc:654] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.699783 17439 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:22.701050 17327 tablet_bootstrap.cc:654] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.704782 17455 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.705314 17455 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.707180 17455 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:22.708631 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:22.709424 17281 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:22.710418 17174 leader_election.cc:343] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.708735 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:22.713078 17175 leader_election.cc:343] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.713517 17175 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:22.714557 17387 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.715785 17207 raft_consensus.cc:2393] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 1: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:22.718809 17563 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:22.721751 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:22.722344 17134 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.723578 17563 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.724057 17563 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:22.725971 17563 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:22.727376 17102 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.729262 17134 raft_consensus.cc:2468] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:22.729775 17447 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:22.730232 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:22.731544 17175 leader_election.cc:343] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.734683 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:22.736019 17177 leader_election.cc:343] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.750316 17177 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.750510 17395 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.751044 17395 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.751575 17455 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:22.753751 17174 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:22.753782 17395 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:22.755111 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:22.755770 17061 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:22.756794 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:22.757984 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:22.762832 17563 raft_consensus.cc:2804] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.763389 17563 raft_consensus.cc:697] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:22.763736 17327 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:22.764215 17327 ts_tablet_manager.cc:1403] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.091s user 0.004s sys 0.008s
I20260201 08:59:22.764199 17563 consensus_queue.cc:237] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.765187 17447 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:22.765576 17447 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:22.765986 17447 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.766937 17327 raft_consensus.cc:359] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.767668 17327 raft_consensus.cc:385] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.767944 17327 raft_consensus.cc:740] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
W20260201 08:59:22.765098 17103 leader_election.cc:343] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.770622 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:22.768594 17327 consensus_queue.cc:260] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.774230 17328 tablet_bootstrap.cc:492] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:22.774704 17328 ts_tablet_manager.cc:1403] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.206s user 0.028s sys 0.029s
I20260201 08:59:22.777591 17327 ts_tablet_manager.cc:1434] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.013s user 0.001s sys 0.005s
I20260201 08:59:22.783367 17327 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:22.784780 17365 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:22.785136 17177 leader_election.cc:343] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.785315 17365 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.787200 17328 raft_consensus.cc:359] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.791929 17328 raft_consensus.cc:385] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.792241 17328 raft_consensus.cc:740] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.792950 17328 consensus_queue.cc:260] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.799268 17332 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:22.799621 17329 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:22.799764 17332 ts_tablet_manager.cc:1403] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.171s user 0.003s sys 0.014s
I20260201 08:59:22.800139 17329 ts_tablet_manager.cc:1403] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.193s user 0.016s sys 0.007s
I20260201 08:59:22.800906 17327 tablet_bootstrap.cc:654] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.776767 17439 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.803881 17328 ts_tablet_manager.cc:1434] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.029s user 0.007s sys 0.000s
I20260201 08:59:22.767119 17387 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:22.807096 17328 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:22.809768 17332 raft_consensus.cc:359] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.811087 17332 raft_consensus.cc:385] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.817925 17365 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:22.819278 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:22.819970 17134 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:22.821265 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:22.806843 17439 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:22.822841 17028 leader_election.cc:343] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.823442 17025 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.811348 17332 raft_consensus.cc:740] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.825610 17332 consensus_queue.cc:260] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:22.827569 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.828475 17332 ts_tablet_manager.cc:1434] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.028s user 0.007s sys 0.001s
I20260201 08:59:22.829506 17332 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:22.829398 17329 raft_consensus.cc:359] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:22.830123 17329 raft_consensus.cc:385] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.830389 17329 raft_consensus.cc:740] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.829268 17207 raft_consensus.cc:2393] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 1: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:22.833390 17365 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:22.837873 17365 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:22.838231 17365 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.837258 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:22.842219 17329 consensus_queue.cc:260] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:22.823491 17439 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.854435 17462 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.856801 17395 consensus_queue.cc:1048] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:22.852169 17532 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:22.857880 17532 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.859495 17329 ts_tablet_manager.cc:1434] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.059s user 0.006s sys 0.001s
I20260201 08:59:22.860927 17329 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:22.856802 17462 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:22.861721 17027 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:22.862489 17462 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:22.865933 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:22.866621 17343 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:22.866866 17395 consensus_queue.cc:1048] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 08:59:22.867292 17177 leader_election.cc:343] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.866554 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:22.864992 17439 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.873339 17455 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.873831 17455 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:22.874068 17028 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 51322.4us
I20260201 08:59:22.875741 17455 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:22.876012 17285 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.877358 17332 tablet_bootstrap.cc:654] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.879516 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:22.879959 17532 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:22.884106 17328 tablet_bootstrap.cc:654] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:22.882102 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:22.887310 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:22.887580 17447 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:22.888639 17177 leader_election.cc:343] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:22.889870 17175 leader_election.cc:343] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.890278 17175 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.891812 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:22.892139 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:22.892403 17061 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.893119 17387 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:22.893916 17103 leader_election.cc:343] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.894568 17449 consensus_queue.cc:1048] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:22.893841 17447 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:22.896166 17329 tablet_bootstrap.cc:654] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:22.896417 17174 leader_election.cc:343] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.896832 17327 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:22.897338 17327 ts_tablet_manager.cc:1403] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.114s user 0.028s sys 0.007s
I20260201 08:59:22.907194 17365 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.896879 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.910260 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:22.911620 17028 leader_election.cc:343] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:22.915215 16956 catalog_manager.cc:5654] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:22.918380 17365 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:22.919430 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:22.920235 17136 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:22.920657 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:22.931228 17250 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:22.932528 17532 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:22.913666 17462 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:22.932734 17136 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:22.936111 17025 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:22.937315 17028 consensus_peers.cc:597] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:22.937485 17343 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.938012 17343 raft_consensus.cc:697] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:22.938807 17343 consensus_queue.cc:237] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.924521 17061 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:22.944182 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:22.945392 17449 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:22.947952 17449 raft_consensus.cc:697] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:22.948820 17449 consensus_queue.cc:237] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.957077 17439 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:22.946218 17328 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:22.960626 17328 ts_tablet_manager.cc:1403] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.154s user 0.013s sys 0.006s
I20260201 08:59:22.967710 17328 raft_consensus.cc:359] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.962349 17365 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:22.979466 17365 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.964375 17447 consensus_queue.cc:1048] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:22.987149 16955 catalog_manager.cc:5654] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:22.991459 17332 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:22.991979 17332 ts_tablet_manager.cc:1403] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.163s user 0.022s sys 0.007s
I20260201 08:59:22.996253 17332 raft_consensus.cc:359] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:22.996966 17332 raft_consensus.cc:385] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:22.997238 17332 raft_consensus.cc:740] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:22.998010 17332 consensus_queue.cc:260] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.001590 17332 ts_tablet_manager.cc:1434] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260201 08:59:23.002482 17332 tablet_bootstrap.cc:492] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.002581 17365 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:22.944339 17327 raft_consensus.cc:359] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.003378 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:23.002879 17329 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.003772 17327 raft_consensus.cc:385] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.004076 17327 raft_consensus.cc:740] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.004199 17329 ts_tablet_manager.cc:1403] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.144s user 0.030s sys 0.007s
I20260201 08:59:23.004770 17327 consensus_queue.cc:260] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.006953 17327 ts_tablet_manager.cc:1434] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.109s user 0.006s sys 0.000s
I20260201 08:59:23.007429 17136 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:23.007861 17327 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:23.008613 17025 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:23.006786 17329 raft_consensus.cc:359] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.009938 17329 raft_consensus.cc:385] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.009941 17343 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.010584 17329 raft_consensus.cc:740] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.010658 17343 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.004104 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:23.010648 17332 tablet_bootstrap.cc:654] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.011336 17343 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.011309 17329 consensus_queue.cc:260] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:23.017519 17028 leader_election.cc:343] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.019814 17329 ts_tablet_manager.cc:1434] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260201 08:59:23.020790 17329 tablet_bootstrap.cc:492] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.025287 17332 tablet_bootstrap.cc:492] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.025802 17332 ts_tablet_manager.cc:1403] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.005s
I20260201 08:59:23.026149 17328 raft_consensus.cc:385] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.026739 17328 raft_consensus.cc:740] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.024317 17343 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.026336 17329 tablet_bootstrap.cc:654] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.032811 17328 consensus_queue.cc:260] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.045488 17328 ts_tablet_manager.cc:1434] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.080s user 0.005s sys 0.000s
I20260201 08:59:23.033449 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:23.034015 17343 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:23.035169 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:23.055034 17136 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:23.055531 17028 leader_election.cc:343] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.050876 17329 tablet_bootstrap.cc:492] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.028825 17332 raft_consensus.cc:359] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.056900 17332 raft_consensus.cc:385] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.056989 17329 ts_tablet_manager.cc:1403] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.000s
I20260201 08:59:23.057232 17332 raft_consensus.cc:740] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.029724 16956 catalog_manager.cc:5654] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:23.058264 17332 consensus_queue.cc:260] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.059448 17329 raft_consensus.cc:359] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.060210 17329 raft_consensus.cc:385] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.060468 17329 raft_consensus.cc:740] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.054316 17327 tablet_bootstrap.cc:654] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.061124 17329 consensus_queue.cc:260] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.060588 17332 ts_tablet_manager.cc:1434] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.034s user 0.004s sys 0.000s
I20260201 08:59:23.064796 17332 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.066991 17327 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:23.067811 17327 ts_tablet_manager.cc:1403] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.060s user 0.011s sys 0.000s
I20260201 08:59:23.070171 17332 tablet_bootstrap.cc:654] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.070263 17327 raft_consensus.cc:359] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.071141 17327 raft_consensus.cc:385] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.071626 17327 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.072490 17327 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.075299 17327 ts_tablet_manager.cc:1434] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:59:23.076984 17327 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:23.080206 17136 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:23.082530 17327 tablet_bootstrap.cc:654] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.090163 17329 ts_tablet_manager.cc:1434] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260201 08:59:23.091406 17329 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.059150 17328 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.099973 17563 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.100476 17563 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.103919 17025 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.104787 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:23.105306 17343 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.105885 17343 raft_consensus.cc:697] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:23.106760 17343 consensus_queue.cc:237] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:23.107682 17177 leader_election.cc:343] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.135403 17328 tablet_bootstrap.cc:654] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.139065 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:23.146050 17175 leader_election.cc:343] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.146507 17175 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.147320 17455 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.140081 17563 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:23.143342 17439 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.148216 17439 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.150102 17439 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.150852 17329 tablet_bootstrap.cc:654] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.152956 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:23.162535 17028 leader_election.cc:343] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.163918 17332 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.164465 17332 ts_tablet_manager.cc:1403] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.100s user 0.037s sys 0.040s
I20260201 08:59:23.164440 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.165218 17210 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:23.166330 17027 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.167517 17343 raft_consensus.cc:2804] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.167198 17332 raft_consensus.cc:359] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.169919 17328 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.173105 17343 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.173465 17328 ts_tablet_manager.cc:1403] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.116s user 0.010s sys 0.001s
I20260201 08:59:23.173622 17343 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.176254 17328 raft_consensus.cc:359] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.177026 17328 raft_consensus.cc:385] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.177289 17328 raft_consensus.cc:740] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.171680 16957 catalog_manager.cc:5654] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:23.173127 17332 raft_consensus.cc:385] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.180032 17332 raft_consensus.cc:740] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.180706 17332 consensus_queue.cc:260] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.183189 17332 ts_tablet_manager.cc:1434] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.018s user 0.004s sys 0.000s
I20260201 08:59:23.183735 17328 consensus_queue.cc:260] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.186278 17328 ts_tablet_manager.cc:1434] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.012s user 0.002s sys 0.004s
I20260201 08:59:23.187487 17332 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.194043 17332 tablet_bootstrap.cc:654] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:23.200359 17177 consensus_peers.cc:597] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:23.201772 17328 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.202064 17327 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:23.206538 17327 ts_tablet_manager.cc:1403] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.130s user 0.016s sys 0.000s
I20260201 08:59:23.207540 17328 tablet_bootstrap.cc:654] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.209139 17327 raft_consensus.cc:359] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.209846 17327 raft_consensus.cc:385] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.210099 17327 raft_consensus.cc:740] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.210686 17327 consensus_queue.cc:260] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.212558 17332 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.213174 17332 ts_tablet_manager.cc:1403] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.007s
I20260201 08:59:23.215852 17332 raft_consensus.cc:359] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.216532 17332 raft_consensus.cc:385] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.216800 17332 raft_consensus.cc:740] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.217449 17332 consensus_queue.cc:260] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.219677 17332 ts_tablet_manager.cc:1434] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260201 08:59:23.226347 17328 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.220734 17332 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.226603 17343 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.234580 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:23.235177 17210 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.226913 17328 ts_tablet_manager.cc:1403] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.011s
I20260201 08:59:23.238528 17332 tablet_bootstrap.cc:654] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.239872 17328 raft_consensus.cc:359] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.240549 17328 raft_consensus.cc:385] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.241397 17328 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.242165 17328 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.244539 17328 ts_tablet_manager.cc:1434] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260201 08:59:23.246356 17328 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.231694 17327 ts_tablet_manager.cc:1434] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260201 08:59:23.250066 17327 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:23.252054 17328 tablet_bootstrap.cc:654] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.250926 17210 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:23.253568 17027 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:23.255039 17343 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.254518 17439 raft_consensus.cc:2804] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.256811 17439 raft_consensus.cc:697] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:23.257611 17439 consensus_queue.cc:237] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.264516 17447 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.265173 17447 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.269994 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:23.273067 17028 leader_election.cc:343] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.274784 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.275394 17061 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:23.275928 17327 tablet_bootstrap.cc:654] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.281816 17101 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:23.281924 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.283213 17210 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:23.283962 17382 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.284404 17382 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.284752 17382 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.281311 17447 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.293993 17332 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.294461 17332 ts_tablet_manager.cc:1403] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.074s user 0.018s sys 0.018s
I20260201 08:59:23.294976 17329 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.295464 17329 ts_tablet_manager.cc:1403] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.204s user 0.057s sys 0.032s
I20260201 08:59:23.296890 17332 raft_consensus.cc:359] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.297477 17332 raft_consensus.cc:385] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.297726 17332 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.298409 17332 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.298785 17329 raft_consensus.cc:359] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.299438 17329 raft_consensus.cc:385] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.299707 17329 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.300532 17329 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.305234 17332 ts_tablet_manager.cc:1434] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260201 08:59:23.325337 16957 catalog_manager.cc:5654] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:23.329625 17329 ts_tablet_manager.cc:1434] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.034s user 0.006s sys 0.001s
I20260201 08:59:23.330727 17329 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.333353 17382 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.335958 17382 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.337388 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:23.338131 17059 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.339248 17332 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.343802 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:23.344519 17207 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.342255 17455 consensus_queue.cc:1048] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260201 08:59:23.348824 17329 tablet_bootstrap.cc:654] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.352080 17332 tablet_bootstrap.cc:654] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.359037 17059 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
W20260201 08:59:23.360105 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:23.360205 17101 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:23.361212 17352 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.361676 17352 raft_consensus.cc:697] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:23.362782 17327 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:23.362461 17352 consensus_queue.cc:237] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.363281 17327 ts_tablet_manager.cc:1403] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.113s user 0.016s sys 0.010s
I20260201 08:59:23.353598 17207 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:23.364591 17328 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.366400 17328 ts_tablet_manager.cc:1403] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.120s user 0.015s sys 0.031s
I20260201 08:59:23.369065 17328 raft_consensus.cc:359] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.369673 17328 raft_consensus.cc:385] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.369940 17328 raft_consensus.cc:740] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.371868 17327 raft_consensus.cc:359] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.372532 17327 raft_consensus.cc:385] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.372821 17327 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.373418 17327 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.370589 17328 consensus_queue.cc:260] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.378132 17327 ts_tablet_manager.cc:1434] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260201 08:59:23.386808 17327 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:23.389990 17332 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.390501 17332 ts_tablet_manager.cc:1403] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.077s user 0.010s sys 0.003s
I20260201 08:59:23.387049 17352 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.393146 17531 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.393952 17329 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.393653 17531 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.394572 17329 ts_tablet_manager.cc:1403] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.064s user 0.011s sys 0.003s
I20260201 08:59:23.395695 17531 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:23.396495 16956 catalog_manager.cc:5654] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:23.397223 17062 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.398279 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:23.398232 17329 raft_consensus.cc:359] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.399017 17329 raft_consensus.cc:385] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.399286 17329 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.399982 17329 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.402144 17329 ts_tablet_manager.cc:1434] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260201 08:59:23.403147 17329 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.406266 17248 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:23.408044 17531 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.408519 17329 tablet_bootstrap.cc:654] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.397181 17332 raft_consensus.cc:359] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.409138 17328 ts_tablet_manager.cc:1434] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.042s user 0.005s sys 0.000s
I20260201 08:59:23.409379 17332 raft_consensus.cc:385] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.409680 17332 raft_consensus.cc:740] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.410333 17328 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.410336 17332 consensus_queue.cc:260] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.412550 17332 ts_tablet_manager.cc:1434] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.022s user 0.004s sys 0.000s
I20260201 08:59:23.414543 17332 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.408712 17343 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260201 08:59:23.416487 17328 tablet_bootstrap.cc:654] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.425597 17327 tablet_bootstrap.cc:654] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.425843 17343 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.428771 17332 tablet_bootstrap.cc:654] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.430670 17343 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.432536 17343 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.433455 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:23.433774 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.434496 17207 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:23.435907 17027 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:23.448750 17343 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.449234 17343 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.449550 17343 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.449725 17329 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.450181 17329 ts_tablet_manager.cc:1403] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.001s
I20260201 08:59:23.434178 17134 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:23.465651 17281 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.460592 17285 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:23.471122 17103 consensus_peers.cc:597] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:23.474838 17343 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.477358 17343 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.478680 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:23.479336 17207 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.485597 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:23.486292 17134 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.487174 17328 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.487660 17328 ts_tablet_manager.cc:1403] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.078s user 0.041s sys 0.016s
I20260201 08:59:23.490059 17328 raft_consensus.cc:359] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.490676 17328 raft_consensus.cc:385] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.490926 17328 raft_consensus.cc:740] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.493566 17328 consensus_queue.cc:260] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.495645 17328 ts_tablet_manager.cc:1434] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260201 08:59:23.496084 17327 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:23.502322 17327 ts_tablet_manager.cc:1403] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.116s user 0.007s sys 0.014s
I20260201 08:59:23.491071 17329 raft_consensus.cc:359] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.503579 17328 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.504298 17329 raft_consensus.cc:385] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.504592 17329 raft_consensus.cc:740] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.505268 17329 consensus_queue.cc:260] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.507396 17329 ts_tablet_manager.cc:1434] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.057s user 0.005s sys 0.000s
I20260201 08:59:23.508383 17329 tablet_bootstrap.cc:492] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.509876 17455 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.510392 17455 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.511417 17327 raft_consensus.cc:359] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.512593 17327 raft_consensus.cc:385] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.515681 17327 raft_consensus.cc:740] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.498601 17134 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:23.514467 17614 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.512297 17455 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.515506 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:23.519914 17174 leader_election.cc:343] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.520792 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:23.522298 17177 leader_election.cc:343] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.515249 17343 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.522806 17177 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.523594 17455 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.523128 17343 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.526877 17025 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:23.529708 17614 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.530194 17614 raft_consensus.cc:697] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:23.531028 17614 consensus_queue.cc:237] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.527693 17328 tablet_bootstrap.cc:654] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.528156 17329 tablet_bootstrap.cc:654] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.540673 17447 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.541175 17447 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.543802 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.543872 17447 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.544440 17210 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:23.545446 17102 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:23.545454 17329 tablet_bootstrap.cc:492] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.546582 17329 ts_tablet_manager.cc:1403] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.038s user 0.010s sys 0.000s
I20260201 08:59:23.544826 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:23.548686 17449 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.549189 17449 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.549536 17449 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:23.549798 17103 leader_election.cc:343] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.551025 17365 consensus_queue.cc:1048] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.556741 17449 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.559742 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:23.560426 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:23.560972 17103 leader_election.cc:343] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.561147 17210 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.561640 17449 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.562633 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.563294 17209 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:23.565151 17328 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.565611 17328 ts_tablet_manager.cc:1403] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.062s user 0.011s sys 0.000s
I20260201 08:59:23.567184 17027 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:23.567972 17328 raft_consensus.cc:359] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.568629 17328 raft_consensus.cc:385] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.569496 17365 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.568998 17329 raft_consensus.cc:359] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.570366 17365 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.570746 17329 raft_consensus.cc:385] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.570843 17365 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.571161 17210 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:23.571051 17329 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.571974 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:23.572258 17102 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.572921 17285 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:23.573603 17447 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.573347 17329 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.574115 17447 raft_consensus.cc:697] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:23.508701 17207 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:23.575534 17327 consensus_queue.cc:260] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.576700 17329 ts_tablet_manager.cc:1434] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.030s user 0.002s sys 0.004s
I20260201 08:59:23.577050 17531 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.579174 17531 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.580322 17329 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.580130 17447 consensus_queue.cc:237] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.581116 17531 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:23.583397 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.584190 17210 raft_consensus.cc:2393] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 1: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:23.577499 17327 ts_tablet_manager.cc:1434] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.075s user 0.003s sys 0.002s
I20260201 08:59:23.577095 17614 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.586370 17329 tablet_bootstrap.cc:654] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.586215 17614 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.587692 17365 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.589881 17365 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.590430 17328 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.590569 17332 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.591142 17332 ts_tablet_manager.cc:1403] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.177s user 0.017s sys 0.018s
I20260201 08:59:23.591253 17328 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.590669 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.593657 17332 raft_consensus.cc:359] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.594309 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:23.595129 17281 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.595400 17249 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:23.596586 17327 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:23.596503 17531 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.594375 17332 raft_consensus.cc:385] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.601003 17332 raft_consensus.cc:740] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.601637 17332 consensus_queue.cc:260] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.601962 17281 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:23.603735 17332 ts_tablet_manager.cc:1434] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20260201 08:59:23.605805 17329 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.607846 17329 ts_tablet_manager.cc:1403] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.000s
I20260201 08:59:23.605738 17028 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:23.608309 17332 tablet_bootstrap.cc:492] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.609109 17439 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.609576 17439 raft_consensus.cc:697] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:23.610472 17439 consensus_queue.cc:237] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.611879 17449 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.612480 17449 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.615258 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:23.616547 17102 leader_election.cc:343] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.617414 17449 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.607832 17327 tablet_bootstrap.cc:654] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.617599 16956 catalog_manager.cc:5654] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:23.618356 17329 raft_consensus.cc:359] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.619103 17329 raft_consensus.cc:385] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.619349 17329 raft_consensus.cc:740] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.606900 17531 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.620018 17329 consensus_queue.cc:260] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.626224 17332 tablet_bootstrap.cc:654] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.630182 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:23.632753 17025 leader_election.cc:343] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.633724 17614 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.634981 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.636360 17328 ts_tablet_manager.cc:1434] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.070s user 0.006s sys 0.000s
I20260201 08:59:23.636819 17352 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.637416 17328 tablet_bootstrap.cc:492] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.637348 17352 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.639281 17352 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:23.639271 17329 ts_tablet_manager.cc:1434] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260201 08:59:23.640724 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:23.642395 17103 leader_election.cc:343] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.640789 17329 tablet_bootstrap.cc:492] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.645946 17352 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.646507 17352 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.648764 17352 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.649396 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.650089 17207 raft_consensus.cc:2468] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:23.651252 17102 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:23.651602 17328 tablet_bootstrap.cc:654] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:23.636786 17027 leader_election.cc:343] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.652227 17352 raft_consensus.cc:2804] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.652374 17027 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:23.652649 17352 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.654513 17329 tablet_bootstrap.cc:654] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.655017 17449 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.611867 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:23.660168 17352 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.660534 17449 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.662461 17449 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:23.663702 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:23.656046 17332 tablet_bootstrap.cc:492] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
W20260201 08:59:23.665206 17103 leader_election.cc:343] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.661886 17439 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.665203 17332 ts_tablet_manager.cc:1403] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.057s user 0.012s sys 0.000s
I20260201 08:59:23.667312 17352 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.669286 17210 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.669507 17332 raft_consensus.cc:359] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.670183 17332 raft_consensus.cc:385] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.670809 17332 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.671535 17332 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.673929 17332 ts_tablet_manager.cc:1434] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:59:23.674289 17328 tablet_bootstrap.cc:492] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.674801 17328 ts_tablet_manager.cc:1403] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.038s user 0.012s sys 0.000s
I20260201 08:59:23.675019 17332 tablet_bootstrap.cc:492] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.676432 17531 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.574461 17343 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.676965 17531 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.678934 17531 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:23.679345 17352 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:23.681102 17332 tablet_bootstrap.cc:654] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.681452 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.682106 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:23.682710 17207 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.685326 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.690450 17250 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:23.691732 17531 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.693295 17332 tablet_bootstrap.cc:492] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.694000 17207 raft_consensus.cc:2468] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:23.694552 17332 ts_tablet_manager.cc:1403] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.003s
I20260201 08:59:23.695222 17102 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:23.696756 17449 raft_consensus.cc:2804] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:23.697252 17449 raft_consensus.cc:697] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
W20260201 08:59:23.697728 17028 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 81014.1us
I20260201 08:59:23.689507 17328 raft_consensus.cc:359] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.698498 17328 raft_consensus.cc:385] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.698812 17328 raft_consensus.cc:740] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.699968 17327 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:23.700487 17327 ts_tablet_manager.cc:1403] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.104s user 0.010s sys 0.007s
I20260201 08:59:23.703732 17329 tablet_bootstrap.cc:492] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.704226 17329 ts_tablet_manager.cc:1403] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.064s user 0.012s sys 0.006s
I20260201 08:59:23.708192 17328 consensus_queue.cc:260] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.711195 17328 ts_tablet_manager.cc:1434] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.024s user 0.004s sys 0.000s
I20260201 08:59:23.718600 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.726643 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.727442 17210 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:23.732375 17328 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.698027 17449 consensus_queue.cc:237] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.737217 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.737942 17382 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.738418 17382 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.738641 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:23.739919 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:23.740336 17382 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:23.742266 17332 raft_consensus.cc:359] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.743091 17332 raft_consensus.cc:385] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.743736 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:23.745028 17103 leader_election.cc:343] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.743341 17332 raft_consensus.cc:740] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.747594 17329 raft_consensus.cc:359] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:23.748631 17101 leader_election.cc:343] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.748284 17329 raft_consensus.cc:385] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.749197 17329 raft_consensus.cc:740] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.749168 17101 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:23.749323 17332 consensus_queue.cc:260] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.750355 17382 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.750109 17329 consensus_queue.cc:260] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.728757 17327 raft_consensus.cc:359] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.751189 17327 raft_consensus.cc:385] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.751468 17327 raft_consensus.cc:740] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.751823 17332 ts_tablet_manager.cc:1434] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.057s user 0.004s sys 0.001s
I20260201 08:59:23.752087 17327 consensus_queue.cc:260] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.752616 17332 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.754304 17327 ts_tablet_manager.cc:1434] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20260201 08:59:23.755246 17327 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:23.747262 16955 catalog_manager.cc:5654] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:23.758016 16955 catalog_manager.cc:5654] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:23.759495 17329 ts_tablet_manager.cc:1434] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.055s user 0.005s sys 0.001s
I20260201 08:59:23.760941 16956 catalog_manager.cc:5654] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:23.760627 17329 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.765766 17284 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.767485 17332 tablet_bootstrap.cc:654] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.769776 17329 tablet_bootstrap.cc:654] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.769905 17328 tablet_bootstrap.cc:654] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
W20260201 08:59:23.774034 17101 leader_election.cc:343] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.774504 17101 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.775566 17447 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:23.776669 17101 leader_election.cc:343] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:23.777904 17101 leader_election.cc:343] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.778318 17101 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.779340 17447 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:23.780354 17101 leader_election.cc:343] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.784039 17652 consensus_queue.cc:1048] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.786079 17652 consensus_queue.cc:1048] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.788504 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:23.796278 17101 leader_election.cc:343] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.796820 17101 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:23.797909 17447 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:23.800422 17382 consensus_queue.cc:1048] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.806638 17328 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.807121 17328 ts_tablet_manager.cc:1403] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.075s user 0.013s sys 0.006s
I20260201 08:59:23.811053 17332 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.811623 17328 raft_consensus.cc:359] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.812335 17328 raft_consensus.cc:385] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.812428 17332 ts_tablet_manager.cc:1403] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.060s user 0.009s sys 0.011s
I20260201 08:59:23.812631 17328 raft_consensus.cc:740] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.818028 17332 raft_consensus.cc:359] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.818817 17332 raft_consensus.cc:385] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.819131 17332 raft_consensus.cc:740] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.817183 17328 consensus_queue.cc:260] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.819797 17332 consensus_queue.cc:260] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:23.822042 17332 ts_tablet_manager.cc:1434] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:59:23.823354 17332 tablet_bootstrap.cc:492] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.828820 17332 tablet_bootstrap.cc:654] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.841437 17332 tablet_bootstrap.cc:492] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.842008 17332 ts_tablet_manager.cc:1403] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.007s
I20260201 08:59:23.844529 17332 raft_consensus.cc:359] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.845302 17332 raft_consensus.cc:385] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.845611 17332 raft_consensus.cc:740] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.845991 17328 ts_tablet_manager.cc:1434] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260201 08:59:23.846400 17332 consensus_queue.cc:260] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.848934 17332 ts_tablet_manager.cc:1434] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260201 08:59:23.849880 17332 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2: Bootstrap starting.
I20260201 08:59:23.852092 17327 tablet_bootstrap.cc:654] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.856220 17332 tablet_bootstrap.cc:654] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.860775 17328 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.868729 17332 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2: No bootstrap required, opened a new log
I20260201 08:59:23.869360 17332 ts_tablet_manager.cc:1403] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.006s
I20260201 08:59:23.871342 17447 consensus_queue.cc:1048] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.871435 17652 consensus_queue.cc:1048] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:23.871831 17332 raft_consensus.cc:359] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.872973 17332 raft_consensus.cc:385] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.873291 17332 raft_consensus.cc:740] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.874089 17332 consensus_queue.cc:260] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:23.876667 17332 ts_tablet_manager.cc:1434] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:59:23.877553 17328 tablet_bootstrap.cc:654] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.897855 17328 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:23.898610 17328 ts_tablet_manager.cc:1403] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.007s
I20260201 08:59:23.901450 17328 raft_consensus.cc:359] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.902213 17328 raft_consensus.cc:385] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.902530 17328 raft_consensus.cc:740] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.903476 17328 consensus_queue.cc:260] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.906173 17328 ts_tablet_manager.cc:1434] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260201 08:59:23.907128 17328 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:23.913376 17328 tablet_bootstrap.cc:654] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.927865 17447 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:23.928498 17447 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.930534 17447 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:23.932780 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:23.933589 17207 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:23.934173 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:23.935001 17102 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:23.935742 17103 leader_election.cc:343] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:23.937033 17382 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:23.937515 17382 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:23.937855 17382 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:23.962494 17329 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:23.963063 17329 ts_tablet_manager.cc:1403] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.203s user 0.059s sys 0.103s
I20260201 08:59:23.966275 17329 raft_consensus.cc:359] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.966944 17329 raft_consensus.cc:385] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:23.967207 17329 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:23.967875 17329 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:23.970224 17329 ts_tablet_manager.cc:1434] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260201 08:59:23.971132 17329 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:23.972385 17352 consensus_queue.cc:1048] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:23.980664 17329 tablet_bootstrap.cc:654] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:23.974977 17382 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:23.991675 17327 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:23.992167 17327 ts_tablet_manager.cc:1403] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.237s user 0.009s sys 0.001s
I20260201 08:59:24.034890 17327 raft_consensus.cc:359] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.035573 17327 raft_consensus.cc:385] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.035742 17563 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.036353 17563 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.038334 17563 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:24.043556 17343 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:24.035858 17327 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.045426 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:24.046177 17327 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.060240 17328 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:24.060070 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:24.060801 17328 ts_tablet_manager.cc:1403] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.154s user 0.028s sys 0.022s
I20260201 08:59:24.063443 17327 ts_tablet_manager.cc:1434] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.071s user 0.013s sys 0.001s
W20260201 08:59:24.064404 17177 leader_election.cc:343] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.065655 17328 raft_consensus.cc:359] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.066335 17328 raft_consensus.cc:385] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.066586 17328 raft_consensus.cc:740] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.067157 17328 consensus_queue.cc:260] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.051614 17652 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.075861 17327 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:24.078899 17328 ts_tablet_manager.cc:1434] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260201 08:59:24.078805 17652 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.076081 17382 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:24.074860 17175 leader_election.cc:343] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.097615 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:24.098313 17211 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.098820 17387 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.099324 17387 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.101173 17328 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:24.111434 17327 tablet_bootstrap.cc:654] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.115144 17284 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
W20260201 08:59:24.095468 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 102998us
I20260201 08:59:24.119499 17343 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.120018 17343 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.102473 17175 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:24.122890 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:24.118811 17211 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:24.123049 17343 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:24.125355 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:24.105302 17652 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:24.129014 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:24.129796 17281 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
W20260201 08:59:24.131629 17028 leader_election.cc:343] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.132301 17028 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:24.133412 17447 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.133919 17447 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.134282 17652 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.134728 17652 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.135046 17652 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.136597 17387 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:24.137019 17447 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:24.143887 17462 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:24.144058 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 72440.1us
I20260201 08:59:24.160992 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:24.161659 17061 raft_consensus.cc:2468] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 0.
I20260201 08:59:24.164101 17329 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
I20260201 08:59:24.164674 17329 ts_tablet_manager.cc:1403] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.194s user 0.036s sys 0.044s
I20260201 08:59:24.165006 17101 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:24.166285 17447 raft_consensus.cc:2804] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.166651 17447 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.166975 17447 raft_consensus.cc:3060] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.167528 17329 raft_consensus.cc:359] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.168233 17329 raft_consensus.cc:385] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.168473 17329 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.169183 17329 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.171051 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:24.178514 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:24.179244 17208 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:24.185555 17677 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.186169 17677 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.188336 17677 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:24.189105 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:24.189345 17102 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:24.189772 17134 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:24.191358 17382 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.191828 17382 raft_consensus.cc:697] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:24.192602 17382 consensus_queue.cc:237] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:24.197307 17103 leader_election.cc:343] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:24.198362 17103 consensus_peers.cc:597] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:24.201118 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:24.202208 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:24.202852 17209 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:24.204202 17532 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.204674 17532 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.206535 17532 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:24.208199 17174 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:24.210690 17177 leader_election.cc:343] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.213310 17328 tablet_bootstrap.cc:654] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.217763 17329 ts_tablet_manager.cc:1434] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20260201 08:59:24.225625 17329 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Bootstrap starting.
I20260201 08:59:24.227280 17365 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:24.214697 17387 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.230661 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:24.219482 17102 leader_election.cc:343] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.230623 17387 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.216066 17439 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260201 08:59:24.234709 17532 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.261668 17027 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:24.262020 17532 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.264259 17532 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:24.266279 17652 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.268344 17652 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:24.234477 17447 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:24.271576 17101 consensus_peers.cc:597] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:24.256693 17387 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.272974 17447 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:24.270435 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:24.270558 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:24.275168 17327 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:24.275656 17327 ts_tablet_manager.cc:1403] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.204s user 0.024s sys 0.013s
I20260201 08:59:24.235174 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:24.278534 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 69414.3us
W20260201 08:59:24.278820 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 61978.1us
I20260201 08:59:24.287731 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:24.288338 17061 raft_consensus.cc:3060] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.280684 17280 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.284607 17614 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.286443 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:24.293388 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:24.285712 17206 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
W20260201 08:59:24.281260 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 44025.8us
I20260201 08:59:24.308320 16955 catalog_manager.cc:5654] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:24.318634 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:24.327796 17210 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.328469 17061 raft_consensus.cc:2468] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:24.303897 17134 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
W20260201 08:59:24.337527 17249 leader_election.cc:343] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:24.337745 17103 leader_election.cc:343] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.338914 17681 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.339419 17681 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.341459 17681 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:24.299548 17614 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.346436 17327 raft_consensus.cc:359] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.347234 17327 raft_consensus.cc:385] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.347498 17327 raft_consensus.cc:740] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.348210 17327 consensus_queue.cc:260] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.350317 17210 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:24.306145 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:24.350880 17614 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.373190 17327 ts_tablet_manager.cc:1434] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.097s user 0.007s sys 0.000s
I20260201 08:59:24.373497 17365 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.374012 17365 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.381220 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:24.381889 17365 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:24.364616 17387 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.395473 17327 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
W20260201 08:59:24.386150 17027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 74472us
I20260201 08:59:24.405958 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:24.406667 17206 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:24.408668 17209 raft_consensus.cc:2393] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 1: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:24.417979 17688 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.418577 17688 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.420701 17688 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:24.410145 17387 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:24.421934 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:24.401214 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:24.432224 17249 leader_election.cc:343] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:24.438333 17102 leader_election.cc:343] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.417572 17280 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:24.444388 17680 consensus_queue.cc:1048] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260201 08:59:24.445798 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:24.447580 17327 tablet_bootstrap.cc:654] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.448046 17652 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:24.403192 17248 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:24.463521 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 64909.6us
I20260201 08:59:24.460767 17134 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
W20260201 08:59:24.465641 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 57045us
I20260201 08:59:24.467556 17688 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.468106 17688 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.468529 17688 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.461925 17101 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:24.465834 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:24.478348 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:24.478104 17103 leader_election.cc:343] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.479820 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:24.480639 17680 raft_consensus.cc:2804] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.489034 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:24.489637 17133 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.478466 17025 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:24.481604 17250 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:24.488380 17207 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
W20260201 08:59:24.487983 17101 leader_election.cc:343] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.501240 17439 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.502110 17439 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.502569 17439 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.493429 17680 raft_consensus.cc:697] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:24.509243 17532 raft_consensus.cc:2804] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.511113 17532 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.511466 17532 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.514371 17680 consensus_queue.cc:237] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.518281 17328 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:24.518757 17328 ts_tablet_manager.cc:1403] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.426s user 0.009s sys 0.010s
I20260201 08:59:24.519907 17250 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:24.521028 17685 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.521394 17685 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.512723 17101 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:24.521741 17685 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.522076 17329 tablet_bootstrap.cc:654] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.523425 17328 raft_consensus.cc:359] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.524123 17328 raft_consensus.cc:385] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.524385 17328 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.525097 17328 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:24.527172 17177 leader_election.cc:343] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.504470 17027 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:24.538498 17651 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.539827 17651 raft_consensus.cc:697] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:24.539295 17614 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.540768 17651 consensus_queue.cc:237] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.542433 17614 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:24.543262 17028 leader_election.cc:343] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.546342 17102 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:24.547444 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:24.549695 17028 leader_election.cc:343] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.533313 17681 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260201 08:59:24.554564 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 67130.8us
I20260201 08:59:24.565649 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:24.566288 17209 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.578820 17387 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.589010 17387 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.590839 17387 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:24.592069 17685 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.593966 17688 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.595896 17688 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:24.596393 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:24.596927 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:24.597250 17134 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 0.
I20260201 08:59:24.597787 17135 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.600793 17174 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:24.606204 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:24.606791 17206 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.607941 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:24.609351 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:24.609252 17328 ts_tablet_manager.cc:1434] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.090s user 0.006s sys 0.002s
I20260201 08:59:24.610513 17692 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:24.610875 17328 tablet_bootstrap.cc:492] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:24.610984 17692 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:24.611444 17692 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.588380 17209 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:24.617328 17328 tablet_bootstrap.cc:654] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.606868 17685 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:24.619496 17249 leader_election.cc:343] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.632189 16957 catalog_manager.cc:5654] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:24.630832 17692 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.631335 17329 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d: No bootstrap required, opened a new log
W20260201 08:59:24.635928 17103 consensus_peers.cc:597] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:24.639674 17329 ts_tablet_manager.cc:1403] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent bootstrapping tablet: real 0.414s user 0.013s sys 0.003s
I20260201 08:59:24.644382 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:24.646176 17135 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:24.648089 17248 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:24.649041 17685 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.649516 17685 raft_consensus.cc:697] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:24.649691 17532 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.650709 17685 consensus_queue.cc:237] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.648411 17329 raft_consensus.cc:359] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.652382 17329 raft_consensus.cc:385] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.652647 17329 raft_consensus.cc:740] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.653303 17329 consensus_queue.cc:260] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.654392 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:24.655071 17209 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.656136 17329 ts_tablet_manager.cc:1434] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260201 08:59:24.660111 17027 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:24.660959 17365 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.661417 17365 raft_consensus.cc:697] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:24.662135 17365 consensus_queue.cc:237] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.651660 17327 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:24.664211 17327 ts_tablet_manager.cc:1403] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.275s user 0.019s sys 0.014s
I20260201 08:59:24.627486 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:24.669663 17207 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.671382 17061 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:24.672643 17249 leader_election.cc:343] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.651769 17133 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:24.673678 17352 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:24.674214 17327 raft_consensus.cc:359] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.674922 17327 raft_consensus.cc:385] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.675189 17327 raft_consensus.cc:740] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.676049 17327 consensus_queue.cc:260] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.676942 17174 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:24.716527 17206 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:24.717443 17062 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.706024 17209 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
W20260201 08:59:24.690835 17175 leader_election.cc:343] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.685993 17327 ts_tablet_manager.cc:1434] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20260201 08:59:24.704716 17692 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:24.678297 17532 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:24.723392 17250 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:24.685441 17352 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260201 08:59:24.725307 17685 raft_consensus.cc:2804] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.725344 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:24.726002 17685 raft_consensus.cc:697] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:24.721505 17327 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:24.723604 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:24.683087 17693 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.727172 17685 consensus_queue.cc:237] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.687004 17207 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:24.732925 17135 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.742497 17281 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.748185 17135 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:24.749679 17693 raft_consensus.cc:697] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:24.750563 17693 consensus_queue.cc:237] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.686414 17439 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.771122 16955 catalog_manager.cc:5654] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 1 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:24.761241 16956 catalog_manager.cc:5654] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:24.764393 17250 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:24.757550 17175 leader_election.cc:343] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.786813 17174 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:24.788046 17688 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.788690 17688 raft_consensus.cc:697] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:24.788604 17692 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.789740 17688 consensus_queue.cc:237] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:24.790818 17692 raft_consensus.cc:697] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:24.791544 17692 consensus_queue.cc:237] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:24.806653 17328 tablet_bootstrap.cc:492] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:24.807132 17328 ts_tablet_manager.cc:1403] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.196s user 0.015s sys 0.001s
W20260201 08:59:24.785280 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 44105.3us
I20260201 08:59:24.816524 17439 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:24.821892 17328 raft_consensus.cc:359] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.823803 17328 raft_consensus.cc:385] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.824096 17328 raft_consensus.cc:740] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.829800 17328 consensus_queue.cc:260] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.831308 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:24.832655 17028 leader_election.cc:343] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:24.837344 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:24.837992 17134 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.848344 16956 catalog_manager.cc:5654] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:24.852834 16956 catalog_manager.cc:5654] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:24.859171 16958 catalog_manager.cc:5654] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:24.861672 17328 ts_tablet_manager.cc:1434] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.054s user 0.005s sys 0.002s
I20260201 08:59:24.856710 16955 catalog_manager.cc:5654] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:24.866313 17328 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:24.854907 17327 tablet_bootstrap.cc:654] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.867762 17134 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:24.868840 17025 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:24.870285 17365 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:24.870711 17365 raft_consensus.cc:697] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:24.871428 17365 consensus_queue.cc:237] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.874181 17685 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:24.874716 17685 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.919800 17328 tablet_bootstrap.cc:654] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.925714 17327 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:24.926180 17327 ts_tablet_manager.cc:1403] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.205s user 0.019s sys 0.000s
I20260201 08:59:24.929128 17685 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:24.930684 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:24.929512 17327 raft_consensus.cc:359] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.932500 17327 raft_consensus.cc:385] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.933084 17327 raft_consensus.cc:740] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.935689 17327 consensus_queue.cc:260] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.946691 16955 catalog_manager.cc:5654] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 0 to 1, leader changed from <none> to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 1 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:24.953826 17327 ts_tablet_manager.cc:1434] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260201 08:59:24.955317 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:24.957495 17327 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:24.962548 17328 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:24.963125 17328 ts_tablet_manager.cc:1403] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.097s user 0.013s sys 0.005s
I20260201 08:59:24.964064 17685 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:24.964706 17327 tablet_bootstrap.cc:654] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.964600 17685 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:24.965615 17328 raft_consensus.cc:359] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.966291 17328 raft_consensus.cc:385] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:24.966557 17328 raft_consensus.cc:740] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:24.966655 17685 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:24.967365 17328 consensus_queue.cc:260] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:24.969511 17328 ts_tablet_manager.cc:1434] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:24.969362 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:24.970472 17328 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:24.971931 17248 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:24.976764 17328 tablet_bootstrap.cc:654] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:24.978535 17652 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:24.993775 17209 raft_consensus.cc:3060] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:24.999348 17352 consensus_queue.cc:1048] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:25.017043 16958 catalog_manager.cc:5654] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:25.033382 17652 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.042448 17531 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:25.048471 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 76616.6us
I20260201 08:59:25.049656 17693 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.054911 17693 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:25.051410 17681 consensus_queue.cc:1048] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.059643 17693 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:25.060595 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.062381 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:25.064018 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.064139 17175 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:25.069037 17327 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:25.069645 17327 ts_tablet_manager.cc:1403] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.112s user 0.071s sys 0.024s
I20260201 08:59:25.072463 17327 raft_consensus.cc:359] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:25.073166 17327 raft_consensus.cc:385] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.073505 17327 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.074185 17327 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:25.076884 17327 ts_tablet_manager.cc:1434] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260201 08:59:25.077909 17327 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:25.088111 17280 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.094496 17327 tablet_bootstrap.cc:654] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.108815 17614 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260201 08:59:25.125648 17028 consensus_peers.cc:597] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:25.135533 17693 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:25.166165 17248 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:25.169615 17692 consensus_queue.cc:1048] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260201 08:59:25.179970 17177 consensus_peers.cc:597] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:25.209131 17249 consensus_peers.cc:597] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:25.214164 17532 consensus_queue.cc:1048] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.219483 17328 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.220013 17328 ts_tablet_manager.cc:1403] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.250s user 0.054s sys 0.118s
I20260201 08:59:25.222875 17327 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:25.223678 17729 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.224686 17328 raft_consensus.cc:359] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.224705 17327 ts_tablet_manager.cc:1403] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.147s user 0.051s sys 0.017s
I20260201 08:59:25.225471 17729 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.227561 17729 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:25.228109 17531 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:25.229871 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:25.230541 17059 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:25.225533 17328 raft_consensus.cc:385] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.232225 17328 raft_consensus.cc:740] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.232534 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.233211 17135 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:25.233069 17328 consensus_queue.cc:260] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.233566 17249 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:25.234431 17531 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:25.234787 17531 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:25.235111 17531 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.235515 17328 ts_tablet_manager.cc:1434] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260201 08:59:25.236500 17328 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:25.244359 17328 tablet_bootstrap.cc:654] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.244419 17531 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.247504 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:25.248135 17059 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.253897 17328 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.254443 17328 ts_tablet_manager.cc:1403] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.008s
I20260201 08:59:25.254536 17728 consensus_queue.cc:1048] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260201 08:59:25.256439 17531 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:25.260828 17327 raft_consensus.cc:359] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.261574 17327 raft_consensus.cc:385] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.261840 17327 raft_consensus.cc:740] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.262481 17327 consensus_queue.cc:260] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.264685 17327 ts_tablet_manager.cc:1434] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.039s user 0.005s sys 0.000s
I20260201 08:59:25.265712 17327 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:25.257870 17688 consensus_queue.cc:1048] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.256894 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:25.269881 17135 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.271304 17327 tablet_bootstrap.cc:654] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.257059 17328 raft_consensus.cc:359] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.273437 17328 raft_consensus.cc:385] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.273691 17328 raft_consensus.cc:740] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.274302 17328 consensus_queue.cc:260] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.276433 17328 ts_tablet_manager.cc:1434] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260201 08:59:25.278179 17062 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.284255 17328 tablet_bootstrap.cc:492] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:25.264569 17059 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:25.296801 17249 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:25.297732 17531 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:25.298556 17531 raft_consensus.cc:697] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:25.299918 17728 consensus_queue.cc:1048] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.300412 17531 consensus_queue.cc:237] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.306592 17328 tablet_bootstrap.cc:654] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.309347 17135 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:25.345494 16957 catalog_manager.cc:5654] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:25.348466 17652 consensus_queue.cc:1048] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:25.356837 17327 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:25.357445 17327 ts_tablet_manager.cc:1403] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.092s user 0.037s sys 0.008s
I20260201 08:59:25.363917 17327 raft_consensus.cc:359] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.364598 17327 raft_consensus.cc:385] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.364885 17327 raft_consensus.cc:740] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.365514 17327 consensus_queue.cc:260] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.366657 17614 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.367079 17614 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:25.367784 17327 ts_tablet_manager.cc:1434] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
W20260201 08:59:25.368590 17028 consensus_peers.cc:597] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f -> Peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Couldn't send request to peer f97c64e8acf34ae28a520dd40fc5281c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:25.368722 17327 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:25.373670 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.374518 17135 raft_consensus.cc:2393] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 1: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:25.375816 17327 tablet_bootstrap.cc:654] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.376816 17059 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.368718 17614 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:25.388518 17462 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:25.390889 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:25.393760 17328 tablet_bootstrap.cc:492] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.393945 17027 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:25.394289 17328 ts_tablet_manager.cc:1403] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.110s user 0.012s sys 0.001s
I20260201 08:59:25.394902 17652 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:25.396752 17328 raft_consensus.cc:359] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.397497 17328 raft_consensus.cc:385] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.397768 17328 raft_consensus.cc:740] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.399858 17328 consensus_queue.cc:260] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.406059 17728 consensus_queue.cc:1048] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.412246 17280 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.424182 17728 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.425154 17728 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.432478 17462 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260201 08:59:25.434530 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:25.435238 17207 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:25.437067 17250 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:25.438863 17728 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:25.439813 17728 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:25.440181 17728 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:25.440543 17728 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.440361 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:25.442381 17249 leader_election.cc:343] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:25.450645 17328 ts_tablet_manager.cc:1434] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20260201 08:59:25.472880 17327 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:25.473518 17327 ts_tablet_manager.cc:1403] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.105s user 0.032s sys 0.043s
I20260201 08:59:25.473793 17328 tablet_bootstrap.cc:492] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:25.481033 17327 raft_consensus.cc:359] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.481725 17327 raft_consensus.cc:385] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.481993 17327 raft_consensus.cc:740] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.482666 17327 consensus_queue.cc:260] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.485035 17327 ts_tablet_manager.cc:1434] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
I20260201 08:59:25.486824 17327 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:25.487793 17439 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.488276 17439 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.491348 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:25.490157 17439 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:25.493115 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.493702 17134 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 0.
I20260201 08:59:25.494894 17025 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 08:59:25.496308 17028 leader_election.cc:343] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:25.497471 17439 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:25.498018 17439 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:25.499238 17439 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.507375 17328 tablet_bootstrap.cc:654] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.513305 17327 tablet_bootstrap.cc:654] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.512878 17439 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.483259 17728 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.520093 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:25.520676 17209 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.524895 17439 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:25.525954 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:25.526417 17728 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:25.526548 17134 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.528487 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:25.528894 17209 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:25.529635 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:25.530933 17250 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:25.532156 17249 leader_election.cc:343] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:25.533169 17134 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:25.534260 17025 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 08:59:25.535020 17028 leader_election.cc:343] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:25.536044 17439 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:25.536634 17439 raft_consensus.cc:697] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:25.537511 17439 consensus_queue.cc:237] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.538120 17532 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.538628 17532 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.534638 17728 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:25.542932 17532 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:25.544596 17059 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:25.546082 17249 leader_election.cc:343] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:25.546706 17728 raft_consensus.cc:697] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:25.547428 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.548162 17135 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 0.
I20260201 08:59:25.548137 17728 consensus_queue.cc:237] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.549753 17248 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:25.560068 17328 tablet_bootstrap.cc:492] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.560696 17328 ts_tablet_manager.cc:1403] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.087s user 0.020s sys 0.016s
I20260201 08:59:25.563870 17328 raft_consensus.cc:359] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.564530 17328 raft_consensus.cc:385] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.564780 17328 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.565834 17532 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 08:59:25.566416 17532 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:25.566828 17532 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.567382 17327 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:25.567902 17327 ts_tablet_manager.cc:1403] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.081s user 0.017s sys 0.005s
I20260201 08:59:25.593708 17327 raft_consensus.cc:359] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.594408 17327 raft_consensus.cc:385] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.594664 17327 raft_consensus.cc:740] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.595247 17327 consensus_queue.cc:260] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.597471 17327 ts_tablet_manager.cc:1434] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.029s user 0.013s sys 0.005s
I20260201 08:59:25.598590 17327 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:25.601655 17328 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.604074 17328 ts_tablet_manager.cc:1434] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.043s user 0.009s sys 0.006s
I20260201 08:59:25.605198 17328 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:25.613368 17327 tablet_bootstrap.cc:654] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.619191 17328 tablet_bootstrap.cc:654] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.625581 17327 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: No bootstrap required, opened a new log
I20260201 08:59:25.626050 17327 ts_tablet_manager.cc:1403] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.028s user 0.008s sys 0.003s
I20260201 08:59:25.628409 17327 raft_consensus.cc:359] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.629163 17327 raft_consensus.cc:385] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.629426 17327 raft_consensus.cc:740] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.633257 17328 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.633827 17328 ts_tablet_manager.cc:1403] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.029s user 0.011s sys 0.002s
I20260201 08:59:25.636747 17328 raft_consensus.cc:359] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.637490 17328 raft_consensus.cc:385] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.637753 17328 raft_consensus.cc:740] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.638062 17062 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.638363 17328 consensus_queue.cc:260] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.640607 17328 ts_tablet_manager.cc:1434] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:59:25.631119 17327 consensus_queue.cc:260] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.643124 17327 ts_tablet_manager.cc:1434] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260201 08:59:25.643643 17688 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.644173 17688 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.645975 17328 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:25.649400 17281 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.654876 17328 tablet_bootstrap.cc:654] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.646049 17688 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:25.663808 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:25.666244 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.669117 17250 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:25.735193 16960 catalog_manager.cc:5654] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:25.738701 17685 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:25.766934 17328 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.719449 17532 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.777263 17328 ts_tablet_manager.cc:1403] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.132s user 0.048s sys 0.039s
I20260201 08:59:25.779218 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:25.779865 17060 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.780395 17328 raft_consensus.cc:359] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.781088 17328 raft_consensus.cc:385] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.781334 17328 raft_consensus.cc:740] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.781937 17328 consensus_queue.cc:260] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.784071 17328 ts_tablet_manager.cc:1434] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:59:25.784148 17532 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:25.784792 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:25.787921 17133 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.789207 17328 tablet_bootstrap.cc:492] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:25.789518 17060 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:25.790737 17249 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:25.792083 17685 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 08:59:25.792805 17685 raft_consensus.cc:697] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:25.795462 17328 tablet_bootstrap.cc:654] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.795765 17685 consensus_queue.cc:237] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:25.800520 16958 catalog_manager.cc:5654] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 0 to 1, leader changed from <none> to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 1 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:25.786522 17282 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:25.806293 17328 tablet_bootstrap.cc:492] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.806782 17328 ts_tablet_manager.cc:1403] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.001s
I20260201 08:59:25.807456 17133 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:25.809259 17328 raft_consensus.cc:359] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.809947 17328 raft_consensus.cc:385] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.810204 17328 raft_consensus.cc:740] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.810838 17328 consensus_queue.cc:260] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.813069 17328 ts_tablet_manager.cc:1434] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260201 08:59:25.813993 17328 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Bootstrap starting.
I20260201 08:59:25.819659 17328 tablet_bootstrap.cc:654] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Neither blocks nor log segments found. Creating new log.
I20260201 08:59:25.834955 17328 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: No bootstrap required, opened a new log
I20260201 08:59:25.835348 17328 ts_tablet_manager.cc:1403] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.004s
I20260201 08:59:25.837716 17328 raft_consensus.cc:359] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.838368 17328 raft_consensus.cc:385] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 08:59:25.838613 17328 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Initialized, Role: FOLLOWER
I20260201 08:59:25.839184 17328 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.841614 17328 ts_tablet_manager.cc:1434] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260201 08:59:25.844390 17008 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260201 08:59:25.846033 16960 catalog_manager.cc:5654] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 0 to 1, leader changed from <none> to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 1 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:25.862869 17532 consensus_queue.cc:1048] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.876844 17532 consensus_queue.cc:1048] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:25.902801 17532 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.903230 17532 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:25.905074 17532 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:25.905428 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:25.905656 17060 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:25.906925 17249 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:25.907562 17532 raft_consensus.cc:2749] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:25.938701 17532 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:25.939138 17532 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:25.940883 17532 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:25.941720 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:25.941828 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:25.943177 17250 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:25.943749 17532 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260201 08:59:25.985263 17282 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.005582 17282 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.014631 17652 consensus_queue.cc:1048] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:26.038442 17060 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.045786 17614 consensus_queue.cc:1048] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:26.053273 17532 consensus_queue.cc:1048] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:26.061265 17614 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:26.061779 17614 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:26.065470 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:26.065763 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:26.066154 17206 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:26.067596 17027 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:26.068154 17439 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:26.068456 17439 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:26.068773 17439 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:26.071333 17614 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:26.073540 17685 consensus_queue.cc:1048] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:26.074523 17439 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:26.075609 17060 raft_consensus.cc:1240] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:26.076529 17439 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:26.077482 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:26.078377 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:26.078902 17685 consensus_queue.cc:1059] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:26.079694 17685 raft_consensus.cc:3055] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:26.079990 17028 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:26.080018 17685 raft_consensus.cc:740] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:26.082027 17685 consensus_queue.cc:260] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:26.083060 17614 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:26.083220 17685 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:26.217881 17282 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 0 FOLLOWER]: Advancing to term 1
I20260201 08:59:26.298813 17685 consensus_queue.cc:1048] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:26.307839 17728 consensus_queue.cc:1048] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 08:59:27.491070 14089 tablet_server.cc:178] TabletServer@127.13.194.65:0 shutting down...
W20260201 08:59:27.500640 17101 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 105 similar messages]
W20260201 08:59:27.503579 17101 consensus_peers.cc:597] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.531899 17175 consensus_peers.cc:597] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.538661 17249 consensus_peers.cc:597] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.541879 14089 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 08:59:27.547555 14089 tablet_replica.cc:333] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.548411 14089 raft_consensus.cc:2243] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.549081 14089 raft_consensus.cc:2272] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.551226 14089 tablet_replica.cc:333] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.551988 14089 raft_consensus.cc:2243] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.552423 14089 pending_rounds.cc:70] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Trying to abort 1 pending ops.
I20260201 08:59:27.552668 14089 pending_rounds.cc:77] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7249659353305444352 op_type: NO_OP noop_request { }
I20260201 08:59:27.553119 14089 raft_consensus.cc:2889] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260201 08:59:27.553400 14089 raft_consensus.cc:2272] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.555156 14089 tablet_replica.cc:333] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.555716 14089 raft_consensus.cc:2243] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.556456 14089 raft_consensus.cc:2272] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.558053 14089 tablet_replica.cc:333] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.558593 14089 raft_consensus.cc:2243] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.558967 14089 raft_consensus.cc:2272] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.560694 14089 tablet_replica.cc:333] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.561383 14089 raft_consensus.cc:2243] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.561792 14089 raft_consensus.cc:2272] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:27.562708 17175 consensus_peers.cc:597] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.563666 14089 tablet_replica.cc:333] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.564288 14089 raft_consensus.cc:2243] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.564656 14089 raft_consensus.cc:2272] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.566672 14089 tablet_replica.cc:333] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.567236 14089 raft_consensus.cc:2243] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.567927 14089 raft_consensus.cc:2272] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.569578 14089 tablet_replica.cc:333] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.570142 14089 raft_consensus.cc:2243] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.570528 14089 raft_consensus.cc:2272] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.572340 14089 tablet_replica.cc:333] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.573072 14089 raft_consensus.cc:2243] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
W20260201 08:59:27.573431 17101 consensus_peers.cc:597] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.573937 14089 raft_consensus.cc:2272] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.575637 14089 tablet_replica.cc:333] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.576299 14089 raft_consensus.cc:2243] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.577008 14089 raft_consensus.cc:2272] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.577524 17387 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:27.578018 17387 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:27.579216 14089 tablet_replica.cc:333] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.580049 14089 raft_consensus.cc:2243] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.581036 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:27.581641 17284 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:27.581014 14089 raft_consensus.cc:2272] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.579726 17387 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:27.583865 17177 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:27.584571 14089 tablet_replica.cc:333] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.584626 17387 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:27.585143 17387 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:27.585454 17387 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:27.585601 17175 leader_election.cc:336] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260201 08:59:27.585538 14089 raft_consensus.cc:2243] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.586439 14089 raft_consensus.cc:2272] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.588312 14089 tablet_replica.cc:333] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.588922 14089 raft_consensus.cc:2243] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.589334 14089 raft_consensus.cc:2272] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.591653 14089 tablet_replica.cc:333] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.592216 17387 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:27.592639 14089 raft_consensus.cc:2243] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260201 08:59:27.593034 17101 consensus_peers.cc:597] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.593310 14089 raft_consensus.cc:2272] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.594726 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:27.595671 14089 tablet_replica.cc:333] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.596483 14089 raft_consensus.cc:2243] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.596988 14089 raft_consensus.cc:2272] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.599157 14089 tablet_replica.cc:333] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.599231 17282 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:27.600008 14089 raft_consensus.cc:2243] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.600281 17177 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:27.600570 14089 raft_consensus.cc:2272] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.601195 17692 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:27.601552 17387 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:27.603329 14089 tablet_replica.cc:333] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.604176 14089 raft_consensus.cc:2243] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.605154 14089 raft_consensus.cc:2272] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.607458 14089 tablet_replica.cc:333] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.608193 14089 raft_consensus.cc:2243] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.609086 14089 raft_consensus.cc:2272] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.611228 14089 tablet_replica.cc:333] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.612114 14089 raft_consensus.cc:2243] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.612634 14089 raft_consensus.cc:2272] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.614843 14089 tablet_replica.cc:333] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.615545 14089 raft_consensus.cc:2243] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.616020 14089 raft_consensus.cc:2272] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.618144 14089 tablet_replica.cc:333] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
W20260201 08:59:27.618777 17175 leader_election.cc:336] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260201 08:59:27.618961 14089 raft_consensus.cc:2243] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.619561 14089 raft_consensus.cc:2272] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.620635 17692 raft_consensus.cc:697] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:27.621922 14089 tablet_replica.cc:333] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.621636 17692 consensus_queue.cc:237] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:27.622874 14089 raft_consensus.cc:2243] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.623369 14089 raft_consensus.cc:2272] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.625449 14089 tablet_replica.cc:333] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.626338 14089 raft_consensus.cc:2243] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.627184 14089 raft_consensus.cc:2272] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.629118 14089 tablet_replica.cc:333] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.629909 14089 raft_consensus.cc:2243] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.630417 14089 raft_consensus.cc:2272] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:27.630836 17175 consensus_peers.cc:597] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.632655 14089 tablet_replica.cc:333] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.632251 16957 catalog_manager.cc:5654] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:27.633499 14089 raft_consensus.cc:2243] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.634413 14089 raft_consensus.cc:2272] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.636840 14089 tablet_replica.cc:333] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.637713 14089 raft_consensus.cc:2243] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.638250 14089 raft_consensus.cc:2272] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.640898 14089 tablet_replica.cc:333] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.641690 14089 raft_consensus.cc:2243] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.642079 14089 raft_consensus.cc:2272] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.643859 14089 tablet_replica.cc:333] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.644642 14089 raft_consensus.cc:2243] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.645614 14089 raft_consensus.cc:2272] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.647469 14089 tablet_replica.cc:333] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.648126 14089 raft_consensus.cc:2243] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.648504 14089 raft_consensus.cc:2272] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.650444 14089 tablet_replica.cc:333] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.651185 14089 raft_consensus.cc:2243] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.651616 14089 raft_consensus.cc:2272] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.653375 14089 tablet_replica.cc:333] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.653998 14089 raft_consensus.cc:2243] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.654354 14089 raft_consensus.cc:2272] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.655952 14089 tablet_replica.cc:333] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.656459 14089 raft_consensus.cc:2243] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.656889 14089 raft_consensus.cc:2272] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.658557 14089 tablet_replica.cc:333] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.659066 14089 raft_consensus.cc:2243] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.659430 14089 raft_consensus.cc:2272] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.661038 14089 tablet_replica.cc:333] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.661537 14089 raft_consensus.cc:2243] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.661901 14089 raft_consensus.cc:2272] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.663499 14089 tablet_replica.cc:333] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.663990 14089 raft_consensus.cc:2243] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.664659 14089 raft_consensus.cc:2272] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.666244 14089 tablet_replica.cc:333] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.666716 14089 raft_consensus.cc:2243] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.667378 14089 raft_consensus.cc:2272] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.669466 14089 tablet_replica.cc:333] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.670125 14089 raft_consensus.cc:2243] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.670575 14089 raft_consensus.cc:2272] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:27.671300 17101 consensus_peers.cc:597] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.672363 14089 tablet_replica.cc:333] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.673036 14089 raft_consensus.cc:2243] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.673403 14089 raft_consensus.cc:2272] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.675010 14089 tablet_replica.cc:333] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.675582 14089 raft_consensus.cc:2243] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.676258 14089 raft_consensus.cc:2272] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.678072 14089 tablet_replica.cc:333] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.678630 14089 raft_consensus.cc:2243] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.679437 14089 raft_consensus.cc:2272] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.681378 14089 tablet_replica.cc:333] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.681851 14089 raft_consensus.cc:2243] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.682191 14089 raft_consensus.cc:2272] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.683701 14089 tablet_replica.cc:333] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.684139 14089 raft_consensus.cc:2243] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.684782 14089 raft_consensus.cc:2272] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.686473 14089 tablet_replica.cc:333] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.686904 14089 raft_consensus.cc:2243] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 08:59:27.687254 14089 raft_consensus.cc:2272] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.688832 14089 tablet_replica.cc:333] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.689303 14089 raft_consensus.cc:2243] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.689960 14089 raft_consensus.cc:2272] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 08:59:27.691433 14089 tablet_replica.cc:333] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: stopping tablet replica
I20260201 08:59:27.691835 14089 raft_consensus.cc:2243] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 LEADER]: Raft consensus shutting down.
I20260201 08:59:27.692494 14089 raft_consensus.cc:2272] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260201 08:59:27.702721 17175 consensus_peers.cc:597] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.715919 17101 consensus_peers.cc:597] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.723457 17175 consensus_peers.cc:597] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.732503 17175 consensus_peers.cc:597] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.756443 14089 tablet_server.cc:195] TabletServer@127.13.194.65:0 shutdown complete.
W20260201 08:59:27.796602 17101 consensus_peers.cc:597] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.813860 14089 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 08:59:27.815053 17101 consensus_peers.cc:597] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.820724 17779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:27.820768 17780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 08:59:27.822255 17782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 08:59:27.823475 14089 server_base.cc:1060] running on GCE node
I20260201 08:59:27.828372 14089 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 08:59:27.828740 14089 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 08:59:27.828989 14089 hybrid_clock.cc:648] HybridClock initialized: now 1769936367828968 us; error 0 us; skew 500 ppm
I20260201 08:59:27.829682 14089 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260201 08:59:27.831573 17249 consensus_peers.cc:597] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.833703 14089 webserver.cc:492] Webserver started at http://127.13.194.65:34593/ using document root <none> and password file <none>
I20260201 08:59:27.834285 14089 fs_manager.cc:362] Metadata directory not provided
I20260201 08:59:27.834462 14089 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 08:59:27.838214 14089 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
W20260201 08:59:27.846800 17175 consensus_peers.cc:597] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.847347 17789 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 08:59:27.848299 14089 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260201 08:59:27.848642 14089 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
uuid: "35484ac93d564e958f85965bd740a18f"
format_stamp: "Formatted at 2026-02-01 08:59:16 on dist-test-slave-7fnp"
I20260201 08:59:27.849140 14089 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskw5qIZd/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1769936248176475-14089-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260201 08:59:27.859423 17249 consensus_peers.cc:597] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.863684 17175 consensus_peers.cc:597] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.866873 17101 consensus_peers.cc:597] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.869865 17101 consensus_peers.cc:597] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.872416 17101 consensus_peers.cc:597] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.876706 17175 consensus_peers.cc:597] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.880627 17101 consensus_peers.cc:597] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:27.897250 17249 consensus_peers.cc:597] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.903697 14089 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 08:59:27.905449 14089 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260201 08:59:27.905601 17101 consensus_peers.cc:597] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:27.907554 14089 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 08:59:27.915113 17797 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260201 08:59:27.993599 17101 consensus_peers.cc:597] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:28.006230 17249 consensus_peers.cc:597] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:28.096323 17282 raft_consensus.cc:1275] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:28.098074 17692 consensus_queue.cc:1048] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260201 08:59:28.147830 17175 consensus_peers.cc:597] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Status: Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:28.182904 14089 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260201 08:59:28.183238 14089 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.272s user 0.010s sys 0.000s
I20260201 08:59:28.183470 14089 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260201 08:59:28.187734 17797 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.202164 17797 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.203011 17797 tablet_bootstrap.cc:492] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.203611 17797 ts_tablet_manager.cc:1403] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260201 08:59:28.205971 17797 raft_consensus.cc:359] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.206604 17797 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.207242 17797 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.209640 17797 ts_tablet_manager.cc:1434] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:28.210413 17797 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.223799 17797 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.224650 17797 tablet_bootstrap.cc:492] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.225303 17797 ts_tablet_manager.cc:1403] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.015s user 0.014s sys 0.000s
I20260201 08:59:28.227339 17797 raft_consensus.cc:359] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.227998 17797 raft_consensus.cc:740] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.228574 17797 consensus_queue.cc:260] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.230377 17797 ts_tablet_manager.cc:1434] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:59:28.231102 17797 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.244053 17797 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.244761 17797 tablet_bootstrap.cc:492] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.245313 17797 ts_tablet_manager.cc:1403] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
I20260201 08:59:28.246766 17797 raft_consensus.cc:359] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.247252 17797 raft_consensus.cc:740] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.247759 17797 consensus_queue.cc:260] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.249121 17797 ts_tablet_manager.cc:1434] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260201 08:59:28.249728 17797 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.261379 17797 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.262254 17797 tablet_bootstrap.cc:492] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.263679 17797 ts_tablet_manager.cc:1403] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260201 08:59:28.266076 17797 raft_consensus.cc:359] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.266733 17797 raft_consensus.cc:740] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.267385 17797 consensus_queue.cc:260] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.269064 17797 ts_tablet_manager.cc:1434] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 08:59:28.269649 17797 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.279774 17797 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.280459 17797 tablet_bootstrap.cc:492] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.280972 17797 ts_tablet_manager.cc:1403] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.004s
I20260201 08:59:28.282457 17797 raft_consensus.cc:359] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.282932 17797 raft_consensus.cc:740] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.283392 17797 consensus_queue.cc:260] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.285061 17797 ts_tablet_manager.cc:1434] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260201 08:59:28.285867 17797 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.300009 17797 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.300933 17797 tablet_bootstrap.cc:492] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.301527 17797 ts_tablet_manager.cc:1403] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.016s user 0.015s sys 0.000s
I20260201 08:59:28.303856 17797 raft_consensus.cc:359] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.304500 17797 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.305239 17797 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.307111 17797 ts_tablet_manager.cc:1434] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:59:28.307804 17797 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.324792 17797 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.325685 17797 tablet_bootstrap.cc:492] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.326279 17797 ts_tablet_manager.cc:1403] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20260201 08:59:28.328447 17797 raft_consensus.cc:359] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.329299 17797 raft_consensus.cc:740] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.329905 17797 consensus_queue.cc:260] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.331779 17797 ts_tablet_manager.cc:1434] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:59:28.332515 17797 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.346690 17797 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.347630 17797 tablet_bootstrap.cc:492] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.348212 17797 ts_tablet_manager.cc:1403] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260201 08:59:28.350373 17797 raft_consensus.cc:359] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.351015 17797 raft_consensus.cc:740] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.351629 17797 consensus_queue.cc:260] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.353691 17797 ts_tablet_manager.cc:1434] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260201 08:59:28.354488 17797 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.367031 17797 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.367864 17797 tablet_bootstrap.cc:492] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.368484 17797 ts_tablet_manager.cc:1403] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260201 08:59:28.370486 17797 raft_consensus.cc:359] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.370970 17797 raft_consensus.cc:740] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.371515 17797 consensus_queue.cc:260] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.373070 17797 ts_tablet_manager.cc:1434] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.004s user 0.004s sys 0.004s
I20260201 08:59:28.373796 17797 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.445607 14089 ts_tablet_manager.cc:616] Registered 45 tablets
I20260201 08:59:28.446018 14089 ts_tablet_manager.cc:595] Time spent register tablets: real 0.263s user 0.234s sys 0.004s
I20260201 08:59:28.474050 17797 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.491386 17797 tablet_bootstrap.cc:492] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.492013 17797 ts_tablet_manager.cc:1403] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.118s user 0.036s sys 0.032s
I20260201 08:59:28.494082 17797 raft_consensus.cc:359] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.494728 17797 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.495371 17797 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.497116 17797 ts_tablet_manager.cc:1434] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 08:59:28.497845 17797 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.512948 17797 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.513929 17797 tablet_bootstrap.cc:492] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.514577 17797 ts_tablet_manager.cc:1403] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.004s
I20260201 08:59:28.516968 17797 raft_consensus.cc:359] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.517665 17797 raft_consensus.cc:740] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.518402 17797 consensus_queue.cc:260] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.519944 17797 ts_tablet_manager.cc:1434] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260201 08:59:28.520561 17797 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.525512 17772 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.526155 17772 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.528488 17772 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.530613 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:28.539099 17175 leader_election.cc:336] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Network error: Client connection negotiation failed: client connection to 127.13.194.65:45571: connect: Connection refused (error 111)
I20260201 08:59:28.539681 17175 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:28.540469 17772 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:28.543808 17797 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.544569 17797 tablet_bootstrap.cc:492] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.545095 17797 ts_tablet_manager.cc:1403] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.003s
I20260201 08:59:28.546788 17797 raft_consensus.cc:359] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.547329 17797 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.547859 17797 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.549404 17797 ts_tablet_manager.cc:1434] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260201 08:59:28.550012 17797 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.563213 17797 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.564106 17797 tablet_bootstrap.cc:492] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.565521 17797 ts_tablet_manager.cc:1403] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20260201 08:59:28.567589 17797 raft_consensus.cc:359] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.568085 17797 raft_consensus.cc:740] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.568622 17797 consensus_queue.cc:260] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.570263 17797 ts_tablet_manager.cc:1434] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260201 08:59:28.570858 17797 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.572186 14089 rpc_server.cc:307] RPC server started. Bound to: 127.13.194.65:45571
I20260201 08:59:28.572319 17873 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.194.65:45571 every 8 connection(s)
I20260201 08:59:28.583606 17387 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.584178 17387 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.584489 17772 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.585167 17772 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.585980 17387 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.595878 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:28.600458 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:28.607674 17772 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.643232 17797 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.644323 17797 tablet_bootstrap.cc:492] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.645061 17797 ts_tablet_manager.cc:1403] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.074s user 0.027s sys 0.028s
I20260201 08:59:28.647421 17797 raft_consensus.cc:359] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.648128 17797 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.649164 17797 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.651211 17797 ts_tablet_manager.cc:1434] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:59:28.652081 17797 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.714555 17797 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.715510 17797 tablet_bootstrap.cc:492] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.716166 17797 ts_tablet_manager.cc:1403] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.064s user 0.018s sys 0.004s
I20260201 08:59:28.718004 17797 raft_consensus.cc:359] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.718508 17797 raft_consensus.cc:740] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.719022 17797 consensus_queue.cc:260] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.721431 17797 ts_tablet_manager.cc:1434] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260201 08:59:28.722255 17797 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.724891 17881 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.725471 17881 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.729084 17812 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.729271 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.729657 17812 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.730037 17848 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:28.731343 17249 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:28.731670 17812 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.732244 17812 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:28.733219 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.733947 17847 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:28.732560 17812 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.735057 17249 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:28.735608 17812 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:28.738400 17685 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:28.738840 17685 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.739189 17685 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:28.740406 17449 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.740918 17449 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.742687 17449 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:28.745877 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.746552 17847 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:28.747705 17101 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:28.748287 17685 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.748764 17681 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:28.749176 17681 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.749478 17681 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:28.751510 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:28.752130 17847 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:28.756933 17881 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.757479 17685 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.760633 17847 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:28.756304 17681 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:28.762684 17249 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:28.763571 17685 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:28.764042 17685 raft_consensus.cc:697] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:28.764884 17685 consensus_queue.cc:237] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.765640 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:28.766271 17848 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:28.776103 17812 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.776512 17772 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.778561 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.778919 17772 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:28.777245 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.781006 17846 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:28.781337 17798 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.781857 17798 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.782188 17772 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.782256 17175 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:28.784186 17812 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.784241 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.779332 17847 raft_consensus.cc:2393] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:28.784793 17798 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:28.786072 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:28.785853 17175 leader_election.cc:343] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:28.786700 17847 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:28.787062 17175 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:28.787804 17387 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:28.790922 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:28.792774 17812 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.793318 17812 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.794270 17847 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:28.795404 17812 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:28.786199 17772 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:28.796561 17249 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:28.799266 17797 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:28.800844 17797 tablet_bootstrap.cc:492] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:28.800876 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.801787 17797 ts_tablet_manager.cc:1403] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.080s user 0.028s sys 0.020s
W20260201 08:59:28.803601 17101 leader_election.cc:343] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:28.804091 17797 raft_consensus.cc:359] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.804774 17797 raft_consensus.cc:740] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:28.805521 17797 consensus_queue.cc:260] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.807571 17797 ts_tablet_manager.cc:1434] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:59:28.807840 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:28.808346 17797 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:28.804136 17101 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:28.807818 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:28.949039 17135 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
W20260201 08:59:28.956912 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 153319us
I20260201 08:59:29.001152 17888 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.001848 17888 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.004442 17888 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.015012 17892 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.015620 17892 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.017642 17892 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.024147 17892 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.024668 17892 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.030027 17892 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:29.033354 17890 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.033617 17894 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.033936 17890 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.034188 17894 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:28.796826 17772 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.035326 17772 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.036002 17890 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:29.036939 17894 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.040549 17772 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.042227 17772 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.042695 17894 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.043227 17894 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.044036 17892 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.044580 17892 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.044946 17894 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.046530 17892 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.064435 17893 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.065100 17893 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.067183 17893 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.071120 17681 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:29.087596 16946 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.506s user 0.000s sys 0.009s
W20260201 08:59:29.088040 16946 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.507s user 0.000s sys 0.010s
I20260201 08:59:29.098968 17387 raft_consensus.cc:2749] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:29.104693 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 308185us
I20260201 08:59:29.105067 17797 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:29.105540 17885 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.106148 17797 tablet_bootstrap.cc:492] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:29.106902 17797 ts_tablet_manager.cc:1403] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.299s user 0.095s sys 0.079s
I20260201 08:59:29.108047 17881 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.108577 17881 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.109652 17797 raft_consensus.cc:359] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.110401 17797 raft_consensus.cc:740] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:29.111068 17797 consensus_queue.cc:260] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.112694 17797 ts_tablet_manager.cc:1434] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:59:29.113590 17797 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:29.118312 17885 raft_consensus.cc:697] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:29.119343 17885 consensus_queue.cc:237] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.119786 17898 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.120874 17898 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.147976 17897 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.153340 17692 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.153968 17692 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.157078 17881 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.158500 17881 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:28.965294 17798 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:29.150557 17898 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.159003 17881 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.151466 17897 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.164786 17692 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.182693 17812 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.183485 17812 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.183928 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.184618 17841 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.185669 17812 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.186317 17812 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.186609 17897 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.186815 17812 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.188086 17897 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.188603 17897 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.189018 17812 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.189689 17812 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.190158 17812 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.190495 17897 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.192047 17812 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.194499 17848 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:29.198195 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.198957 17283 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.199721 17768 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.200281 17768 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.205211 17768 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.206759 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.207497 17846 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.208351 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.208957 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.209180 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.209376 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.210127 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.213907 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.214558 17280 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.216490 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.217173 17843 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:29.217618 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.218201 17285 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.209600 17844 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.221019 17881 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.221764 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.222385 17285 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.224347 17248 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:29.227387 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.228350 17840 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.230808 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.231704 17848 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:29.235188 17874 heartbeater.cc:344] Connected to a master server at 127.13.194.126:42773
I20260201 08:59:29.235757 17874 heartbeater.cc:461] Registering TS with master...
I20260201 08:59:29.236649 17874 heartbeater.cc:507] Master 127.13.194.126:42773 requested a full tablet report, sending...
I20260201 08:59:29.236835 17768 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.238292 17768 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.238720 17768 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.240694 17844 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:29.246232 17768 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.248481 17797 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260201 08:59:29.291951 17175 leader_election.cc:343] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.307899 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.307571 17797 tablet_bootstrap.cc:492] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:29.344990 17175 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:29.315912 17900 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.319401 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:29.352373 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 46372.3us
I20260201 08:59:29.310727 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.314693 17881 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.327040 17895 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.323882 17692 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.354375 17881 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.322975 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.353436 17387 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.352710 17900 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.353034 17283 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.329126 17896 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.360932 17797 ts_tablet_manager.cc:1403] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.248s user 0.020s sys 0.014s
I20260201 08:59:29.361541 17896 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.363813 16957 ts_manager.cc:194] Re-registered known tserver with Master: 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.292776 17101 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:29.354635 17895 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.354287 17175 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:29.336117 16958 catalog_manager.cc:5654] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:29.364454 17896 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:29.365469 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 73147.1us
I20260201 08:59:29.366312 17892 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.374646 17888 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.374855 17892 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.375267 17888 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.353677 17284 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:29.357442 17276 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:29.367053 17387 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.376521 17387 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.374773 17175 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:29.377811 17895 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.378459 17895 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.378933 17895 raft_consensus.cc:697] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:29.367565 17280 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:29.366014 17797 raft_consensus.cc:359] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:29.369099 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 66905.1us
I20260201 08:59:29.381042 17797 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:29.381556 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.381932 17797 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:29.297911 17249 leader_election.cc:343] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.382941 17848 raft_consensus.cc:2393] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
W20260201 08:59:29.384814 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 87145.6us
I20260201 08:59:29.375713 17888 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.355104 17692 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.374259 17101 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:29.375380 17892 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.368466 17900 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.380383 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:29.394063 17175 leader_election.cc:343] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.380318 17895 consensus_queue.cc:237] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.400296 17692 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.401628 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.402736 17892 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:29.403330 17175 leader_election.cc:343] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.405332 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.405817 17797 ts_tablet_manager.cc:1434] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.044s user 0.005s sys 0.005s
I20260201 08:59:29.407262 17797 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:29.409868 17798 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.411023 17387 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.408468 17177 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.413188 17908 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.413578 17908 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.413800 17798 raft_consensus.cc:697] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:29.413968 17908 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.405441 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.414590 17283 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:29.415549 17798 consensus_queue.cc:237] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.419416 17101 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 08:59:29.420523 17101 leader_election.cc:343] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.422235 17891 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.422884 17891 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.423269 17891 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.425223 17276 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
W20260201 08:59:29.421733 17101 leader_election.cc:343] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:29.433274 17101 leader_election.cc:343] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.434057 17101 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:29.248407 17768 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:29.434808 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 51835.4us
I20260201 08:59:29.440377 17387 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.441798 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.442821 17844 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.448113 17892 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.405418 17881 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.457794 17892 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.458287 17892 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.458715 17892 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.458391 17177 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.455874 17908 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.465162 17387 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.465588 17387 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.465955 17387 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.467315 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:29.469120 17175 leader_election.cc:343] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.465806 17177 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:29.473835 17893 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.463338 17888 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.478463 17888 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.479672 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.482617 17846 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.487274 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.490669 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.491750 17843 raft_consensus.cc:2393] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:29.493943 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.494882 17841 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.504873 17893 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:29.506553 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.513667 17387 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.516057 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:29.516803 17283 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.517047 17888 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.517504 17888 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.517863 17888 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.521910 17387 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.469666 17908 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.529932 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.543658 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.527848 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.547886 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.534974 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:29.525246 17844 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:29.548777 17204 raft_consensus.cc:2393] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:29.531131 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.549340 17207 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:29.551921 17175 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:29.522733 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.522892 17895 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.554665 17895 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.544456 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:29.556403 17280 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.532030 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.541426 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:29.536705 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:29.556751 17895 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.540731 17841 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:29.559763 17893 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.578820 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:29.597535 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 74907us
I20260201 08:59:29.576316 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.598315 17103 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.596539 17681 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.583002 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.595534 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.598917 17681 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.599642 17681 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.598490 17848 raft_consensus.cc:2393] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:29.577160 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.602098 17204 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:29.599726 17845 raft_consensus.cc:2393] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:29.603884 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.605059 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.605374 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.581781 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.606940 17840 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:29.603420 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.524163 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.612012 17892 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.611707 17814 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.615669 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.606161 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.616628 17814 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.607513 17842 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:29.617357 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.617676 17814 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.577263 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:29.614885 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:29.577461 17175 leader_election.cc:343] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.577562 17893 raft_consensus.cc:697] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:29.620023 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.620692 17137 raft_consensus.cc:2393] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:29.620591 17893 consensus_queue.cc:237] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.621076 17175 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:29.620708 17847 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.622126 17895 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.622630 17895 raft_consensus.cc:697] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:29.583197 17209 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:29.618858 17681 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.576829 17276 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.627138 17136 raft_consensus.cc:2393] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:29.577785 17907 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:29.629160 17681 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.545737 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.630406 17205 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:29.631412 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:29.632779 17101 leader_election.cc:343] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.633220 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:29.634003 17137 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.635111 17797 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:29.636036 17797 tablet_bootstrap.cc:492] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:29.636628 17797 ts_tablet_manager.cc:1403] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.230s user 0.003s sys 0.017s
I20260201 08:59:29.616540 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.637569 17132 raft_consensus.cc:2393] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:29.636968 16960 catalog_manager.cc:5654] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:29.639114 17895 consensus_queue.cc:237] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.581980 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.641887 17280 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:29.643144 17177 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.570026 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.645064 17907 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.645566 17130 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:29.623608 17892 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.649966 17797 raft_consensus.cc:359] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.650780 17797 raft_consensus.cc:740] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:29.568763 17888 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.661165 17204 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:29.664498 17207 raft_consensus.cc:2393] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:29.655192 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.595187 17891 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:29.606169 17249 leader_election.cc:343] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.558516 17846 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:29.656589 17692 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.658185 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:29.658897 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.659891 17210 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:29.660710 17283 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:29.661227 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.647186 17907 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.666123 17134 raft_consensus.cc:2393] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:29.684197 17208 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.684427 17206 raft_consensus.cc:1275] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:29.685101 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 79009.6us
I20260201 08:59:29.686187 17101 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 08:59:29.687815 17249 leader_election.cc:343] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:29.688544 17249 leader_election.cc:343] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.688930 17248 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:29.689234 17249 leader_election.cc:343] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.666744 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:29.690234 17249 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:29.690620 17282 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.692479 17681 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.693864 17681 raft_consensus.cc:697] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:29.690965 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:29.700646 17797 consensus_queue.cc:260] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.675233 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.703568 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.703987 17839 raft_consensus.cc:2393] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:29.665580 17132 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:29.666960 17891 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:29.664505 17888 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.698658 17387 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:29.709478 17387 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:29.710917 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:29.711265 17387 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:29.711613 17277 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.709484 17284 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.708590 17681 consensus_queue.cc:237] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.674579 17847 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
W20260201 08:59:29.716287 17175 leader_election.cc:343] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.719897 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:29.721611 17900 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.722062 17900 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.722421 17900 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.702420 17692 raft_consensus.cc:697] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:29.727394 17692 consensus_queue.cc:237] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.728845 17387 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:29.714614 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:29.671916 17814 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.730144 17101 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:29.731102 17133 raft_consensus.cc:2393] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:29.731494 17814 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:29.732239 17814 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.733001 17814 raft_consensus.cc:697] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:29.733775 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:29.735285 17101 leader_election.cc:343] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:29.735697 17175 leader_election.cc:343] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.729444 17387 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:29.737473 17387 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.742733 17284 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:29.743384 17768 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:29.745946 17248 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:29.746727 17282 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:29.747799 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.748446 17797 ts_tablet_manager.cc:1434] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.101s user 0.007s sys 0.000s
I20260201 08:59:29.735299 17137 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
W20260201 08:59:29.738595 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 48428.4us
I20260201 08:59:29.753887 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:29.772629 17175 leader_election.cc:343] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.775682 17277 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:29.776527 17881 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:29.749701 17692 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.784935 17797 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:29.795362 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.805799 17210 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:29.799364 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:29.807073 17206 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.798650 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:29.784451 17276 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
W20260201 08:59:29.798123 17249 leader_election.cc:343] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.781654 17692 raft_consensus.cc:697] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:29.811504 17249 leader_election.cc:343] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
W20260201 08:59:29.812144 17249 leader_election.cc:343] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.812515 17177 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.813061 17881 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:29.813598 17893 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:29.814109 17893 raft_consensus.cc:697] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:29.814347 17249 leader_election.cc:343] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:29.733850 17814 consensus_queue.cc:237] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.815557 17893 consensus_queue.cc:237] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.811985 17692 consensus_queue.cc:237] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.816980 17206 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:29.849961 17847 raft_consensus.cc:1275] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:29.851356 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.852885 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.855967 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:29.780715 17900 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:29.857862 17847 raft_consensus.cc:1275] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:29.877844 17283 raft_consensus.cc:2393] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:29.858235 17768 consensus_queue.cc:1048] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260201 08:59:29.886665 17888 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:29.891285 17900 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:29.897943 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:29.899148 17248 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.900921 17250 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:29.906026 17797 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:29.908764 17248 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:29.899959 17900 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:29.910002 17797 tablet_bootstrap.cc:492] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:29.910732 17797 ts_tablet_manager.cc:1403] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.126s user 0.018s sys 0.009s
I20260201 08:59:29.912988 17881 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:29.913440 17797 raft_consensus.cc:359] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.914108 17797 raft_consensus.cc:740] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:29.914747 17797 consensus_queue.cc:260] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:29.916139 17248 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.923080 17905 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.923600 17905 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.923962 17905 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.913179 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:29.929519 17847 raft_consensus.cc:2393] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:29.932379 17102 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:29.933450 17887 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:29.933894 17887 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:29.934257 17887 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:29.935458 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.944376 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:29.919224 16958 catalog_manager.cc:5654] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:29.952157 17797 ts_tablet_manager.cc:1434] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.041s user 0.006s sys 0.001s
W20260201 08:59:29.952723 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 51914.6us
W20260201 08:59:29.963296 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 47252.6us
I20260201 08:59:29.951179 17881 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
W20260201 08:59:30.001542 17232 debug-util.cc:398] Leaking SignalData structure 0x7b080018e860 after lost signal to thread 14092
I20260201 08:59:30.001821 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:30.010174 17250 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:30.015494 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:30.015435 17797 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
W20260201 08:59:30.015077 17101 consensus_peers.cc:597] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260201 08:59:30.013368 17887 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:30.021303 17449 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:30.021788 17449 raft_consensus.cc:697] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
W20260201 08:59:30.022058 17232 debug-util.cc:398] Leaking SignalData structure 0x7b0800340b20 after lost signal to thread 16994
I20260201 08:59:30.022569 17449 consensus_queue.cc:237] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:30.022975 17887 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:30.024559 17925 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.025607 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:30.023523 17232 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5b20 after lost signal to thread 17161
I20260201 08:59:30.030328 17248 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:30.013846 17881 raft_consensus.cc:697] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:30.031441 17925 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.031864 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:30.028769 17905 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:30.032930 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 62971.6us
I20260201 08:59:30.033528 17908 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:30.033938 17908 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:30.034292 17908 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:30.034377 17174 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:30.035195 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:30.035501 17174 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:30.036554 17249 leader_election.cc:343] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:30.036616 17692 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.036996 17895 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.037489 17905 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:30.031603 17924 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:30.039609 17174 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:30.040836 17174 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:30.043547 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:30.043339 17881 consensus_queue.cc:237] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:30.044163 17133 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:30.042169 17896 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.047259 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:30.041258 17692 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.053696 17894 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.054937 17132 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.057940 17250 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:30.060637 17905 raft_consensus.cc:2804] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:30.061041 17905 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:30.066821 17900 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:30.069049 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:30.071792 17250 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:30.073203 17101 leader_election.cc:343] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:30.071501 17905 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:30.080648 17885 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.092648 17927 consensus_queue.cc:1048] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260201 08:59:30.093958 17133 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:30.100919 17248 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:30.101693 17925 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:30.102169 17925 raft_consensus.cc:697] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:30.103044 17839 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.102981 17925 consensus_queue.cc:237] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:30.107189 17232 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa220 after lost signal to thread 17235
W20260201 08:59:30.108886 17232 debug-util.cc:398] Leaking SignalData structure 0x7b08002122e0 after lost signal to thread 17309
I20260201 08:59:30.109932 17924 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:30.113229 17232 debug-util.cc:398] Leaking SignalData structure 0x7b0800308e60 after lost signal to thread 17811
W20260201 08:59:30.114838 17232 debug-util.cc:398] Leaking SignalData structure 0x7b08003241a0 after lost signal to thread 17813
I20260201 08:59:30.117524 17814 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.120191 17908 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:30.135885 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 47946.7us
I20260201 08:59:30.136745 17250 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:30.155870 16960 catalog_manager.cc:5654] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:30.159307 16960 catalog_manager.cc:5654] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:30.160638 17277 raft_consensus.cc:1275] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:30.157712 17232 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef100 after lost signal to thread 17873
I20260201 08:59:30.164196 16956 catalog_manager.cc:5654] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:30.160681 16960 catalog_manager.cc:5654] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:30.150203 17924 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.172564 16960 catalog_manager.cc:5654] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:30.177237 17846 raft_consensus.cc:1275] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.178033 17908 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:30.179636 17276 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:30.172840 16956 catalog_manager.cc:5654] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:30.181895 17387 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.184906 17681 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.190443 16960 catalog_manager.cc:5654] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 2 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:30.190689 16956 catalog_manager.cc:5654] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:30.201252 17278 raft_consensus.cc:1275] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.203742 17277 raft_consensus.cc:1275] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:30.205870 17175 consensus_peers.cc:597] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260201 08:59:30.234736 17907 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.212574 17887 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260201 08:59:30.210212 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:30.267537 17103 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:30.235282 17905 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:30.269429 17839 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.269920 17905 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:30.271968 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:30.272814 17887 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:30.273418 17887 raft_consensus.cc:697] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:30.248874 16958 catalog_manager.cc:5654] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
W20260201 08:59:30.266479 17101 consensus_peers.cc:597] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260201 08:59:30.246057 16956 catalog_manager.cc:5654] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:30.282008 16958 catalog_manager.cc:5654] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
W20260201 08:59:30.286187 17175 leader_election.cc:343] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:30.246225 16957 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34906
I20260201 08:59:30.291966 17895 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260201 08:59:30.314633 17284 raft_consensus.cc:1275] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.316463 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:30.316622 17892 consensus_queue.cc:1048] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.319293 17887 consensus_queue.cc:237] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:30.320348 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:30.322849 17206 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:30.323194 17249 leader_election.cc:343] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Illegal state: must be running to vote when last-logged opid is not known
I20260201 08:59:30.325803 17895 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.330565 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:30.331426 17203 raft_consensus.cc:2393] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:30.324518 16957 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34906 (request call id 1) took 1007 ms. Trace:
I20260201 08:59:30.337487 17202 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.324407 17132 raft_consensus.cc:2393] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:30.337368 16957 rpcz_store.cc:276] 0201 08:59:29.317622 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:29.318565 (+ 943us) service_pool.cc:225] Handling call
0201 08:59:30.324463 (+1005898us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17169,"reported_tablets":45}
I20260201 08:59:30.343789 17277 raft_consensus.cc:1275] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:30.351661 17101 consensus_peers.cc:597] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260201 08:59:30.355700 17874 heartbeater.cc:499] Master 127.13.194.126:42773 was elected leader, sending a full tablet report...
I20260201 08:59:30.363620 17888 consensus_queue.cc:1048] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:30.365077 17277 raft_consensus.cc:1275] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.369966 17797 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:30.373288 17893 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260201 08:59:30.382580 17175 consensus_peers.cc:597] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:30.381873 17101 consensus_peers.cc:597] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260201 08:59:30.411876 17797 tablet_bootstrap.cc:492] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:30.412793 17797 ts_tablet_manager.cc:1403] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.441s user 0.014s sys 0.017s
I20260201 08:59:30.412936 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:30.425912 17175 consensus_peers.cc:597] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:30.425807 17907 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.456203 17839 raft_consensus.cc:1275] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:30.481504 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 51457.8us
I20260201 08:59:30.487890 17283 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.544414 17797 raft_consensus.cc:359] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:30.546593 17797 raft_consensus.cc:740] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:30.547353 17797 consensus_queue.cc:260] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:30.549822 17947 log.cc:927] Time spent T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260201 08:59:30.558185 17206 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:30.559188 17250 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:30.560082 17950 log.cc:927] Time spent T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.204s user 0.000s sys 0.001s
I20260201 08:59:30.569063 17768 raft_consensus.cc:2804] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:30.572402 17102 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:30.571604 17768 raft_consensus.cc:697] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:30.576413 17797 ts_tablet_manager.cc:1434] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.157s user 0.006s sys 0.000s
I20260201 08:59:30.577715 17387 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:30.573433 17137 raft_consensus.cc:1275] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:30.626981 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 61983.3us
I20260201 08:59:30.572539 17907 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260201 08:59:30.630120 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 65916.9us
W20260201 08:59:30.633126 17175 consensus_peers.cc:597] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:30.623189 17894 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:30.627878 17887 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260201 08:59:30.648196 17948 log.cc:927] Time spent T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.127s user 0.000s sys 0.000s
W20260201 08:59:30.664461 17955 log.cc:927] Time spent T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.101s user 0.000s sys 0.001s
I20260201 08:59:30.650924 17881 consensus_queue.cc:1048] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260201 08:59:30.625469 17768 consensus_queue.cc:237] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:30.685673 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 54144.5us
I20260201 08:59:30.722134 17839 raft_consensus.cc:1275] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:30.720772 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 73184us
W20260201 08:59:30.737594 17249 consensus_peers.cc:597] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:30.781589 17175 consensus_peers.cc:597] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260201 08:59:30.784260 16957 catalog_manager.cc:5654] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
W20260201 08:59:30.806429 17101 consensus_peers.cc:597] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:30.807482 17101 consensus_peers.cc:597] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:30.808081 17101 consensus_peers.cc:597] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:30.809013 17890 consensus_queue.cc:1048] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260201 08:59:30.810009 17961 log.cc:927] Time spent T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.077s user 0.000s sys 0.000s
W20260201 08:59:30.840109 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 100117us
I20260201 08:59:30.844029 17277 raft_consensus.cc:1275] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.852314 17134 raft_consensus.cc:1275] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:30.867758 17681 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260201 08:59:30.876288 17101 consensus_peers.cc:597] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:30.877002 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 72964.2us
W20260201 08:59:30.877704 17175 consensus_peers.cc:597] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:30.897655 17249 consensus_peers.cc:597] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:30.908023 17249 consensus_peers.cc:597] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260201 08:59:30.908778 17249 consensus_peers.cc:597] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:30.912189 17101 consensus_peers.cc:597] T e4061439a0974c4d87b3541e46a95fc7 P 3dee892ea94d4f2a92316ad6f79edca2 -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:30.965507 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 49859.3us
I20260201 08:59:30.979398 17905 consensus_queue.cc:1048] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260201 08:59:31.039228 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 157678us
I20260201 08:59:31.047852 17278 raft_consensus.cc:1275] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:31.049049 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 162689us
I20260201 08:59:31.057307 17959 consensus_queue.cc:1048] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:31.058991 17797 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
W20260201 08:59:31.078428 17175 consensus_peers.cc:597] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:31.095176 17175 consensus_peers.cc:597] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260201 08:59:31.101938 17797 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.102959 17797 tablet_bootstrap.cc:492] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.106220 17797 ts_tablet_manager.cc:1403] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.047s user 0.018s sys 0.000s
I20260201 08:59:31.108755 17797 raft_consensus.cc:359] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.109457 17797 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.114197 17797 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.120253 17797 ts_tablet_manager.cc:1434] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260201 08:59:31.121145 17797 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.144757 17206 raft_consensus.cc:1275] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:31.168201 17797 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.169370 17797 tablet_bootstrap.cc:492] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.170077 17797 ts_tablet_manager.cc:1403] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.006s
I20260201 08:59:31.172705 17797 raft_consensus.cc:359] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.173501 17797 raft_consensus.cc:740] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.174235 17797 consensus_queue.cc:260] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.176573 17797 ts_tablet_manager.cc:1434] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:59:31.177477 17797 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
W20260201 08:59:31.206050 17175 consensus_peers.cc:597] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260201 08:59:31.212815 17249 consensus_peers.cc:597] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c -> Peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571): Couldn't send request to peer 35484ac93d564e958f85965bd740a18f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260201 08:59:31.253659 17900 consensus_queue.cc:1048] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:31.258468 17797 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.261013 17797 tablet_bootstrap.cc:492] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.261978 17797 ts_tablet_manager.cc:1403] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.085s user 0.022s sys 0.026s
I20260201 08:59:31.282032 17797 raft_consensus.cc:359] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.282719 17797 raft_consensus.cc:740] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.283406 17797 consensus_queue.cc:260] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.285226 17797 ts_tablet_manager.cc:1434] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260201 08:59:31.285974 17797 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.300465 16956 catalog_manager.cc:5654] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 2, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:31.346345 17797 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.347390 17797 tablet_bootstrap.cc:492] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.348610 17797 ts_tablet_manager.cc:1403] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.017s
I20260201 08:59:31.350970 17797 raft_consensus.cc:359] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.351626 17797 raft_consensus.cc:740] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.352273 17797 consensus_queue.cc:260] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.354473 17797 ts_tablet_manager.cc:1434] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260201 08:59:31.355293 17797 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.376521 17797 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.377458 17797 tablet_bootstrap.cc:492] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.378080 17797 ts_tablet_manager.cc:1403] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.004s
I20260201 08:59:31.380339 17797 raft_consensus.cc:359] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.381008 17797 raft_consensus.cc:740] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.381829 17797 consensus_queue.cc:260] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.384146 17797 ts_tablet_manager.cc:1434] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:59:31.384939 17797 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.407291 17797 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.408257 17797 tablet_bootstrap.cc:492] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.409204 17797 ts_tablet_manager.cc:1403] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.011s
I20260201 08:59:31.411594 17797 raft_consensus.cc:359] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.412287 17797 raft_consensus.cc:740] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.413863 17797 consensus_queue.cc:260] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.416225 17797 ts_tablet_manager.cc:1434] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260201 08:59:31.419518 17797 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.445494 17797 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.446413 17797 tablet_bootstrap.cc:492] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.447029 17797 ts_tablet_manager.cc:1403] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.008s
I20260201 08:59:31.449335 17797 raft_consensus.cc:359] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.449992 17797 raft_consensus.cc:740] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.450771 17797 consensus_queue.cc:260] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.453176 17797 ts_tablet_manager.cc:1434] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:31.453946 17797 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.481783 17797 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.482728 17797 tablet_bootstrap.cc:492] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.483706 17797 ts_tablet_manager.cc:1403] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.030s user 0.012s sys 0.008s
I20260201 08:59:31.486265 17797 raft_consensus.cc:359] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.486929 17797 raft_consensus.cc:740] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.487707 17797 consensus_queue.cc:260] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.490499 17797 ts_tablet_manager.cc:1434] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.007s user 0.008s sys 0.001s
I20260201 08:59:31.491274 17797 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.506639 17797 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.507591 17797 tablet_bootstrap.cc:492] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.508271 17797 ts_tablet_manager.cc:1403] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.003s
I20260201 08:59:31.510566 17797 raft_consensus.cc:359] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.511225 17797 raft_consensus.cc:740] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.511847 17797 consensus_queue.cc:260] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.514109 17797 ts_tablet_manager.cc:1434] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:31.515837 17797 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.535801 17847 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:31.538136 17797 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.542001 17797 tablet_bootstrap.cc:492] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.543010 17797 ts_tablet_manager.cc:1403] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.012s
I20260201 08:59:31.545267 17797 raft_consensus.cc:359] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.545917 17797 raft_consensus.cc:740] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.546509 17797 consensus_queue.cc:260] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.548027 17797 ts_tablet_manager.cc:1434] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260201 08:59:31.548627 17797 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.590392 17797 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.591282 17797 tablet_bootstrap.cc:492] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.591928 17797 ts_tablet_manager.cc:1403] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.043s user 0.016s sys 0.019s
I20260201 08:59:31.594209 17797 raft_consensus.cc:359] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.594679 17797 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.595160 17797 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.597361 17797 ts_tablet_manager.cc:1434] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260201 08:59:31.598126 17797 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.611302 17797 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.612196 17797 tablet_bootstrap.cc:492] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.612725 17797 ts_tablet_manager.cc:1403] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260201 08:59:31.614481 17797 raft_consensus.cc:359] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.614948 17797 raft_consensus.cc:740] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.615479 17797 consensus_queue.cc:260] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.617419 17797 ts_tablet_manager.cc:1434] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260201 08:59:31.618603 17797 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.647378 17797 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.648213 17797 tablet_bootstrap.cc:492] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.648818 17797 ts_tablet_manager.cc:1403] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.030s user 0.017s sys 0.007s
I20260201 08:59:31.650849 17797 raft_consensus.cc:359] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.651482 17797 raft_consensus.cc:740] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.652253 17797 consensus_queue.cc:260] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.654615 17797 ts_tablet_manager.cc:1434] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 08:59:31.656160 17797 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.677985 17797 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.680182 17797 tablet_bootstrap.cc:492] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.680927 17797 ts_tablet_manager.cc:1403] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.025s user 0.019s sys 0.003s
I20260201 08:59:31.683230 17797 raft_consensus.cc:359] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.683874 17797 raft_consensus.cc:740] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.684477 17797 consensus_queue.cc:260] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.686635 17797 ts_tablet_manager.cc:1434] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:59:31.687426 17797 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.703440 17797 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260201 08:59:31.704386 17797 tablet_bootstrap.cc:492] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.705045 17797 ts_tablet_manager.cc:1403] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20260201 08:59:31.707351 17797 raft_consensus.cc:359] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.708127 17797 raft_consensus.cc:740] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.708730 17797 consensus_queue.cc:260] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.710919 17797 ts_tablet_manager.cc:1434] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:59:31.711725 17797 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.726059 17797 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.727030 17797 tablet_bootstrap.cc:492] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.727686 17797 ts_tablet_manager.cc:1403] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20260201 08:59:31.729992 17797 raft_consensus.cc:359] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.730620 17797 raft_consensus.cc:740] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.731304 17797 consensus_queue.cc:260] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.733606 17797 ts_tablet_manager.cc:1434] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260201 08:59:31.735628 17797 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.750213 17847 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:31.773058 17797 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.774056 17797 tablet_bootstrap.cc:492] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.774684 17797 ts_tablet_manager.cc:1403] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.039s user 0.015s sys 0.019s
I20260201 08:59:31.776609 17797 raft_consensus.cc:359] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.777163 17797 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.777882 17797 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.780097 17797 ts_tablet_manager.cc:1434] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 08:59:31.780812 17797 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.802898 17797 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.803769 17797 tablet_bootstrap.cc:492] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.804391 17797 ts_tablet_manager.cc:1403] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.007s
I20260201 08:59:31.806613 17797 raft_consensus.cc:359] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.807250 17797 raft_consensus.cc:740] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.807775 17797 consensus_queue.cc:260] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.809731 17797 ts_tablet_manager.cc:1434] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260201 08:59:31.810319 17797 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.823470 17797 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.824450 17797 tablet_bootstrap.cc:492] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.825143 17797 ts_tablet_manager.cc:1403] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.015s user 0.014s sys 0.000s
I20260201 08:59:31.827149 17797 raft_consensus.cc:359] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.827780 17797 raft_consensus.cc:740] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.828406 17797 consensus_queue.cc:260] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.830668 17797 ts_tablet_manager.cc:1434] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260201 08:59:31.832792 17797 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.861308 17797 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.862211 17797 tablet_bootstrap.cc:492] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.862151 17845 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:31.863032 17797 ts_tablet_manager.cc:1403] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.030s user 0.018s sys 0.002s
I20260201 08:59:31.865485 17797 raft_consensus.cc:359] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.866127 17797 raft_consensus.cc:740] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.866744 17797 consensus_queue.cc:260] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:31.868804 17797 ts_tablet_manager.cc:1434] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260201 08:59:31.869614 17797 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.891520 17797 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.892493 17797 tablet_bootstrap.cc:492] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.893210 17797 ts_tablet_manager.cc:1403] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.005s
I20260201 08:59:31.895519 17797 raft_consensus.cc:359] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.896402 17797 raft_consensus.cc:740] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.897063 17797 consensus_queue.cc:260] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:31.899250 17797 ts_tablet_manager.cc:1434] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260201 08:59:31.900019 17797 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.914238 17843 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:31.932610 17847 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:31.969955 17797 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:31.970958 17797 tablet_bootstrap.cc:492] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:31.971650 17797 ts_tablet_manager.cc:1403] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.072s user 0.030s sys 0.035s
I20260201 08:59:31.974210 17797 raft_consensus.cc:359] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.974915 17797 raft_consensus.cc:740] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:31.975551 17797 consensus_queue.cc:260] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:31.977686 17797 ts_tablet_manager.cc:1434] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260201 08:59:31.978525 17797 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:31.999298 17797 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:32.000180 17797 tablet_bootstrap.cc:492] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:32.000784 17797 ts_tablet_manager.cc:1403] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.003s
I20260201 08:59:32.003022 17797 raft_consensus.cc:359] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:32.003688 17797 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:32.004444 17797 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:32.010452 17797 ts_tablet_manager.cc:1434] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260201 08:59:32.018240 17797 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Bootstrap starting.
I20260201 08:59:32.036020 17797 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 08:59:32.037091 17797 tablet_bootstrap.cc:492] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Bootstrap complete.
I20260201 08:59:32.037806 17797 ts_tablet_manager.cc:1403] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.008s
I20260201 08:59:32.040081 17797 raft_consensus.cc:359] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:32.040812 17797 raft_consensus.cc:740] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Initialized, Role: FOLLOWER
I20260201 08:59:32.041471 17797 consensus_queue.cc:260] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:32.043610 17797 ts_tablet_manager.cc:1434] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260201 08:59:32.225050 17449 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:32.225524 17449 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:32.227734 17449 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:32.228276 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:32.229214 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:32.229353 17847 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:32.229902 17204 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:32.230666 17101 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:32.231789 17449 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:32.232182 17449 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:32.232534 17449 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:32.238073 17449 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:32.239418 17449 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:32.240214 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:32.240289 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:32.241029 17847 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:32.241110 17204 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:32.252255 17847 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:32.254607 17101 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:32.255614 18018 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:32.256062 18018 raft_consensus.cc:697] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:32.256843 18018 consensus_queue.cc:237] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:32.264972 17204 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:32.277827 16958 catalog_manager.cc:5654] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 3, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 3 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:32.349666 17845 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:32.367101 17847 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:32.461030 17847 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:32.772460 17847 raft_consensus.cc:1275] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:32.774097 17449 consensus_queue.cc:1048] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:32.796769 17204 raft_consensus.cc:1275] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:32.798389 17681 consensus_queue.cc:1048] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:38.650478 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:38.697672 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:38.698357 17134 raft_consensus.cc:606] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:38.700929 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:38.701390 17134 raft_consensus.cc:606] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:38.703413 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:38.703842 17134 raft_consensus.cc:606] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:38.705930 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:38.706333 17134 raft_consensus.cc:606] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Received request to transfer leadership to TS f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:38.708336 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6883c591b5547018eba339947c179ce"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:38.708746 17134 raft_consensus.cc:606] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:38.718636 17208 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d454a89732b54703b564e1c647bbb335"
dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:45104
I20260201 08:59:38.719144 17208 raft_consensus.cc:606] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:38.720118 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260201 08:59:38.721298 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:38.721978 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:38.739470 18045 raft_consensus.cc:993] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:38.740002 18045 raft_consensus.cc:1081] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:38.741297 17847 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39018
I20260201 08:59:38.741770 17847 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:38.742026 17847 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:38.746236 17847 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:38.747923 17847 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:38.761361 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:38.761938 17134 raft_consensus.cc:3055] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:38.762260 17134 raft_consensus.cc:740] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:38.762768 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:38.763381 17208 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:38.762969 17134 consensus_queue.cc:260] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:38.764246 17134 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:38.769405 17134 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:38.769860 17208 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:38.770625 17790 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:38.773238 18056 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:38.775486 18056 raft_consensus.cc:697] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:38.776326 18056 consensus_queue.cc:237] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:38.794909 16958 catalog_manager.cc:5654] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 3 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:38.874706 18045 raft_consensus.cc:993] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:38.875217 17449 raft_consensus.cc:1081] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:38.876590 17843 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6883c591b5547018eba339947c179ce"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39018
I20260201 08:59:38.877190 17843 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:38.877547 17843 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:38.884593 17843 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:38.886803 17843 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:38.888409 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:38.889053 17134 raft_consensus.cc:3055] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:38.889344 17134 raft_consensus.cc:740] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:38.889982 17134 consensus_queue.cc:260] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:38.891209 17134 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:38.897519 17134 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:38.898587 17790 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:38.899477 18056 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:38.899951 18056 raft_consensus.cc:697] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:38.900540 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:38.901233 17279 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:38.900774 18056 consensus_queue.cc:237] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:38.909376 17279 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:38.921406 16958 catalog_manager.cc:5654] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 2, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 2 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:38.971539 18045 raft_consensus.cc:993] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower f97c64e8acf34ae28a520dd40fc5281c to start an election
I20260201 08:59:38.971992 17449 raft_consensus.cc:1081] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Signalling peer f97c64e8acf34ae28a520dd40fc5281c to start an election
I20260201 08:59:38.973444 17279 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54632
I20260201 08:59:38.973889 17279 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:38.974189 17279 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:38.979837 17279 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:38.981933 17279 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:38.982520 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:38.982765 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:38.983276 17134 raft_consensus.cc:3055] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:38.983355 17208 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:38.983662 17134 raft_consensus.cc:740] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:38.985461 17134 consensus_queue.cc:260] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:38.986763 17134 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:38.990062 17208 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:38.991276 17250 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:38.991947 18048 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:38.992413 18048 raft_consensus.cc:697] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:38.993288 18048 consensus_queue.cc:237] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:38.993860 17134 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:39.007416 16957 catalog_manager.cc:5654] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 2, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:39.022889 18047 raft_consensus.cc:993] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:39.023375 17907 raft_consensus.cc:1081] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:39.024631 17843 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d454a89732b54703b564e1c647bbb335"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39002
I20260201 08:59:39.025225 17843 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:39.025516 17843 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:39.031445 17843 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:39.033181 17843 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:39.033712 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:39.034291 17208 raft_consensus.cc:3055] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:39.034405 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:39.034628 17208 raft_consensus.cc:740] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:39.035017 17279 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:39.035351 17208 consensus_queue.cc:260] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:39.036617 17208 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:39.044591 17208 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:39.042964 17279 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:39.045672 17793 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:39.046389 18056 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:39.046839 18056 raft_consensus.cc:697] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:39.047138 17449 raft_consensus.cc:993] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:39.047456 17449 raft_consensus.cc:1081] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:39.047606 18056 consensus_queue.cc:237] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:39.049453 17847 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39018
I20260201 08:59:39.049983 17847 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:39.050321 17847 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:39.055846 17847 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:39.057420 17847 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:39.058045 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:39.058597 17208 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:39.059376 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:39.059906 17134 raft_consensus.cc:3055] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:39.060174 17134 raft_consensus.cc:740] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:39.060169 16957 catalog_manager.cc:5654] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 2, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 2 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:39.061388 17134 consensus_queue.cc:260] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:39.063233 17134 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:39.071673 17134 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:39.073770 17208 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:39.704137 17279 raft_consensus.cc:1275] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:39.731858 18070 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:39.742322 17278 raft_consensus.cc:1275] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:39.745208 18070 consensus_queue.cc:1048] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:39.975240 18072 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:39.976150 18072 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:39.980314 18072 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.005506 18056 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.006511 18056 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.026054 18056 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.026679 18056 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.027369 18056 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.043012 18072 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.043928 18072 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.047190 18072 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.077877 18072 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.078701 18072 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.081763 18072 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.086429 18056 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.087132 18056 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.087848 18056 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.104620 18071 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.105723 18071 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.108263 18071 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:40.183130 18071 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.185214 18071 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.187752 18071 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:40.183995 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 45666.6us
I20260201 08:59:40.193912 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.195580 18048 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.196386 18048 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.197184 18079 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.141228 18056 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:40.198019 18079 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.198623 18056 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.199468 18056 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.199766 18048 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.201675 18073 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.202443 18073 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.202703 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.204500 18070 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.205225 18073 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.205834 18048 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.206844 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.206646 18048 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.208039 18078 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.208846 18078 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.211349 18048 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.212873 18071 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.217940 18071 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.213531 18079 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.221783 18078 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.221984 18079 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.222729 18079 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.221036 18071 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:40.205188 18070 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.227195 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.229048 18070 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.232887 18048 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.233631 18048 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.234956 18079 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:40.235538 18079 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.235772 18048 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.245219 18079 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.247565 18079 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.271729 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.272679 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.278435 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.279321 17278 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:40.276875 18070 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.281535 18070 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.283052 18056 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:40.285883 18073 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.286644 18073 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.287209 18048 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.287276 18070 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.287951 18048 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.289618 18073 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.290182 18048 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.291723 18048 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.292392 18048 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.295243 18073 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.296983 18073 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.299521 18073 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.295670 18048 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.305505 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.306319 17848 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:40.308243 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.309062 17840 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:40.309770 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.310546 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.311379 17842 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:40.314172 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.315115 17249 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:40.315913 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.316149 18048 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:40.316663 18048 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.317117 18048 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:40.317528 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.310611 17846 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:40.325034 18073 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.325659 18073 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.325784 17249 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:40.335976 18048 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.327680 18073 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.332234 18072 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:40.370038 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45106 (request call id 2) took 1312 ms. Trace:
I20260201 08:59:40.370564 17208 rpcz_store.cc:276] 0201 08:59:39.057628 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:39.057802 (+ 174us) service_pool.cc:225] Handling call
0201 08:59:40.369768 (+1311966us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:40.361552 18072 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.374938 18072 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:40.386329 17794 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:40.387584 18070 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:40.388013 18070 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.388362 18070 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:40.392042 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 95691.2us
W20260201 08:59:40.413579 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 86001.3us
I20260201 08:59:40.578389 18092 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.579216 18092 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.581732 18092 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.582319 18092 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.585843 18094 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.586615 18094 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.588511 18095 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.589033 18094 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.582947 18092 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.621178 18083 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:40.622061 18083 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.576522 18056 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.626945 18056 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.637444 18056 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.638325 18092 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.600529 18048 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.599390 18094 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.600841 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.597462 18090 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.647518 18090 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.648803 18081 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.649519 18081 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.590512 18072 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.651171 17249 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:40.674147 18102 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.675030 18102 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.626189 18079 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.678912 18088 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.641826 18084 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.651891 18092 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 08:59:40.735638 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 89110.5us
I20260201 08:59:40.657092 18090 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.589355 18095 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.721333 17279 raft_consensus.cc:2393] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:40.745031 17249 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:40.677910 18071 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.748421 18048 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:40.747033 18078 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.756299 18056 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.761751 18100 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.732712 18094 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.765446 18048 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.766868 18090 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.759495 18079 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.774019 18071 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.762353 18092 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.815876 18090 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.769217 18097 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.817992 18101 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:40.815752 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.758555 18084 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.781555 18048 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:40.829895 17278 raft_consensus.cc:2393] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:40.763615 18088 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.815778 18094 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.818544 18100 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.900982 18107 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.901262 18081 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.901531 18099 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.901971 18081 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.902213 18099 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.894313 18097 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.904495 18113 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.893131 18111 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.905191 18096 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.819460 18078 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.894418 18072 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.831871 18056 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.897564 18080 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.901423 18106 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:40.905882 18094 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.930765 18087 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:40.931573 18087 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:40.934587 18087 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.935256 18117 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.936059 18117 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.921155 18095 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.927907 18106 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
W20260201 08:59:40.926278 18070 consensus_meta.cc:287] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.537s user 0.012s sys 0.000s
I20260201 08:59:40.925936 18091 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.919575 18081 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.968106 18071 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:40.968678 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.971024 17848 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:40.968261 18083 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.942943 18072 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.953332 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.968001 18092 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:40.952709 18098 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.907442 18101 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.924108 18107 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.957906 18106 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:40.923744 18096 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.928558 18113 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:40.996714 18121 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.985225 17846 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:40.976905 18071 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.989732 18105 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.990222 18084 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.989383 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:40.965996 18117 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:40.967130 18070 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:40.998396 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:40.954850 18080 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.009389 17848 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:41.009940 18097 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:40.958189 18094 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.002992 18104 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.003315 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:40.997794 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.004647 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:41.005817 18096 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.002503 17278 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:40.989159 18108 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:40.993992 18095 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:40.945878 18111 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:40.992992 18072 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.075582 18102 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.076143 18088 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.012053 18079 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:40.997444 18121 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.080541 18129 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.070245 18087 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.087472 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.076642 17843 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.076610 18090 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.076182 18099 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.091766 17848 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
W20260201 08:59:41.094825 18110 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Append to log took a long time: real 0.183s user 0.000s sys 0.001s
I20260201 08:59:41.095248 18100 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.099129 18120 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:41.082232 18084 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.094061 18079 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.068049 18071 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.080227 18097 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:41.078047 17279 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:40.993362 18091 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.086891 18113 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.104676 18114 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.006723 18098 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.099025 18100 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:41.104758 18095 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.114454 18087 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.104060 18056 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.120510 18127 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:41.120882 18119 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:41.082583 18105 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.109864 18125 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.120894 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:41.121513 18112 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.120400 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.121899 18109 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.122074 18079 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.121191 18072 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.087563 18104 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.116326 18084 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.109711 18078 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.114708 18085 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.121311 18103 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:41.113039 18088 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.136265 18131 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.099762 18120 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.133661 18071 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.119545 18080 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.121255 18123 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:41.124902 18081 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.124359 18118 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:41.125279 18070 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.124787 18116 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:41.136910 17845 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.103668 18108 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.136559 18099 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.115743 18097 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.136479 18087 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.148828 17847 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.136260 18098 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.119194 18129 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.120445 18128 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.124895 18130 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:41.125228 18119 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.140534 18126 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.139292 18100 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.181516 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.124413 18114 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.154850 18103 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.191905 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.179307 18095 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.192155 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.184666 18093 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.151032 18088 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.131026 18127 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.202023 17848 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.187148 18111 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.204274 17130 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:41.190975 18121 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.192830 18099 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.125522 18125 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.189671 18107 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.153734 18109 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.194269 18094 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.197132 18101 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.149675 18112 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.220714 18104 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.195484 18118 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.183830 18085 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.212949 17839 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.179714 18131 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.234443 17134 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:41.225776 18084 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.210578 18130 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.228449 18105 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.213379 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.243336 17130 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:41.232542 18079 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.186321 18123 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.246251 18131 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.246304 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.210314 18128 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.247012 18091 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.251044 18121 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:41.255542 18108 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.255800 18100 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.255569 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.250711 18088 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.204909 18116 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.255723 17129 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.262187 18097 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.263051 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.264385 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.263659 17129 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.250502 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.269965 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.270473 17202 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:41.271023 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.271096 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.261696 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.271791 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.261073 18120 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.275269 17135 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.230319 18126 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.276017 17136 raft_consensus.cc:1275] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:41.276254 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.276435 18099 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.257392 18121 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.276603 18125 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.281386 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.269055 18129 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.236465 18093 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.281822 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.280360 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.283607 18121 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.283931 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.281381 18112 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.285768 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.274224 18119 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.306123 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.306524 18123 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.285137 18127 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.277135 18118 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.307538 18114 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.315294 17136 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:41.307474 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.308718 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:41.320472 17130 raft_consensus.cc:2468] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.320775 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.320957 18130 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.321732 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.320467 17844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 225) took 1014 ms. Trace:
I20260201 08:59:41.322753 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.322981 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.323419 17210 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.324149 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.319687 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.325431 17129 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.322122 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.331113 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.322557 17844 rpcz_store.cc:276] 0201 08:59:40.301923 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:40.307660 (+ 5737us) service_pool.cc:225] Handling call
0201 08:59:41.264599 (+956939us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:41.264796 (+ 197us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:41.278175 (+ 13379us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:41.279591 (+ 1416us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:41.284423 (+ 4832us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:41.308971 (+ 24548us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:41.309061 (+ 90us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:41.315802 (+ 6741us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46353280}
I20260201 08:59:41.337992 18085 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.338589 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.319067 18103 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.341878 18116 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.338990 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.347095 18116 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:41.347819 18116 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.350642 18116 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.352921 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.354625 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:41.355240 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.355866 17840 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.356742 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.357986 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.358057 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.358843 18048 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.360599 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.361168 17210 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.361657 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.362514 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.364123 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.365020 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.365635 17129 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:41.366082 18093 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.366696 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.367053 18128 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.367277 17135 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:41.362792 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.369176 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.369572 17279 raft_consensus.cc:1240] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:41.373216 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.373859 17841 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:41.365689 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.388604 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.388758 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.389716 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.389889 17845 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:41.360846 18048 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.391373 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.389845 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.393620 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.394187 17135 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:41.394506 18126 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.395421 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.391394 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.396621 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.400627 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.401647 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.402427 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.402686 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.403435 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.401000 18139 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.404493 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.403755 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.403553 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.408485 18138 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:41.409516 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.409639 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.410272 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.436771 18138 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.410642 17210 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:41.438474 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.410856 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.439574 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.439085 18138 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.411110 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.411669 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.440691 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.441058 17204 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:41.441236 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.412568 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.442337 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.442675 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.443428 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.443608 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.413589 17209 raft_consensus.cc:1275] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:41.444583 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.416090 18103 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:41.445377 18103 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.447544 18103 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.416605 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.416934 17203 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:41.422305 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.428508 17174 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.429318 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:41.430706 18106 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.462353 18106 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.432107 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.404134 18139 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.436174 17843 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:41.440009 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.474575 18093 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:41.475126 18093 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:41.475468 18093 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:41.480657 18093 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.482838 18139 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.484165 18093 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.489068 17102 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.489209 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.489952 17128 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:41.490636 18095 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.490993 18095 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:41.491248 18095 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.498762 18095 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.501230 18095 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:41.511071 17174 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.512418 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:41.511821 18138 raft_consensus.cc:2804] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.513712 18138 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:41.514056 18138 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.514230 17202 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.514420 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:41.515065 17135 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:41.522583 17135 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:41.522727 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.523470 18138 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.524626 17202 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
W20260201 08:59:41.525722 17790 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.194.66:41977 timed out after 2.000s (SENT) [suppressed 61 similar messages]
I20260201 08:59:41.525875 18138 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.526635 17174 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.529906 18138 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:41.530668 18138 raft_consensus.cc:697] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:41.529945 17102 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.532150 18095 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:41.532644 18095 raft_consensus.cc:697] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:41.533592 18095 consensus_queue.cc:237] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.534441 17249 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.535215 18106 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.535553 18106 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.535888 18106 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.539964 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.540278 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.540795 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.541530 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.541841 17249 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.542230 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.542439 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.542588 18126 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.543021 18126 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.543295 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.543922 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.544548 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.545446 18138 consensus_queue.cc:237] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:41.546576 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.547238 17844 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:41.547857 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:41.548508 17134 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.548702 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:41.549487 17839 raft_consensus.cc:2393] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:41.549649 17249 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.543386 18126 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.550277 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.551421 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.555433 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.556255 17134 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:41.557343 17174 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.548157 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:41.558202 17249 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.559052 17841 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.559542 18109 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:41.560389 18085 raft_consensus.cc:2804] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:41.562076 18085 raft_consensus.cc:697] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:41.562961 18085 consensus_queue.cc:237] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.563822 16957 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34906 (request call id 57) took 2506 ms. Trace:
I20260201 08:59:41.557927 18048 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.565218 18048 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.565564 18048 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.568485 17841 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:41.570024 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:41.570525 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 378733us
I20260201 08:59:41.572517 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.574546 18106 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.577018 18117 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.577414 17793 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.578341 17249 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.579407 18126 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.584576 17848 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:41.586071 17285 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:41.586426 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.589752 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.590346 18128 raft_consensus.cc:2804] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:41.591760 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.594455 18130 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:41.594988 18128 raft_consensus.cc:697] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:41.594493 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:41.585093 18117 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.597834 17249 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.599524 17279 raft_consensus.cc:1240] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:41.594877 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.599954 17249 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.599869 18092 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.597488 17793 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.595656 18129 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.605062 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.605641 17793 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.605720 17285 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.606587 18119 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:41.607244 18119 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:41.608582 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.609522 18129 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.614908 18129 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.614733 17102 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:41.608801 17793 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.616429 18130 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:41.616783 17794 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.617843 17793 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.618316 18123 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:41.619001 18123 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:41.619513 18125 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:41.618994 18095 raft_consensus.cc:2764] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260201 08:59:41.603231 18092 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.621244 18092 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.619932 17794 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.622331 18125 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.622684 18125 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.623031 18125 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.623157 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:41.600423 18117 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.629204 17794 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.630023 18130 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.630378 18130 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.630785 18130 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.611323 17283 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:41.633497 18099 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.633972 18099 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.634332 18099 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.610167 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.637432 18126 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.638053 17248 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.603088 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.638550 17793 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.639243 17278 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.639636 18119 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:41.564216 16957 rpcz_store.cc:276] 0201 08:59:39.057493 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:39.057750 (+ 257us) service_pool.cc:225] Handling call
0201 08:59:41.563619 (+2505869us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 08:59:40.334787 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 08:59:40.336257 (+ 1470us) write_op.cc:432] Acquiring schema lock in shared mode
0201 08:59:40.336325 (+ 68us) write_op.cc:435] Acquired schema lock
0201 08:59:40.336360 (+ 35us) tablet.cc:660] Decoding operations
0201 08:59:40.336820 (+ 460us) write_op.cc:620] Acquiring the partition lock for write op
0201 08:59:40.336935 (+ 115us) write_op.cc:641] Partition lock acquired for write op
0201 08:59:40.336981 (+ 46us) tablet.cc:683] Acquiring locks for 1 operations
0201 08:59:40.337319 (+ 338us) tablet.cc:699] Row locks acquired
0201 08:59:40.337357 (+ 38us) write_op.cc:260] PREPARE: finished
0201 08:59:40.337543 (+ 186us) write_op.cc:270] Start()
0201 08:59:40.373437 (+ 35894us) write_op.cc:276] Timestamp: P: 1769936380337472 usec, L: 0
0201 08:59:40.393117 (+ 19680us) op_driver.cc:348] REPLICATION: starting
0201 08:59:40.735357 (+342240us) log.cc:844] Serialized 540 byte log entry
0201 08:59:41.341186 (+605829us) op_driver.cc:464] REPLICATION: finished
0201 08:59:41.436263 (+ 95077us) write_op.cc:301] APPLY: starting
0201 08:59:41.436359 (+ 96us) tablet.cc:1365] starting BulkCheckPresence
0201 08:59:41.436469 (+ 110us) tablet.cc:1368] finished BulkCheckPresence
0201 08:59:41.436612 (+ 143us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 08:59:41.436939 (+ 327us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 08:59:41.437187 (+ 248us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0201 08:59:41.437264 (+ 77us) write_op.cc:312] APPLY: finished
0201 08:59:41.437539 (+ 275us) log.cc:844] Serialized 22 byte log entry
0201 08:59:41.437707 (+ 168us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:41.437778 (+ 71us) write_op.cc:454] Released schema lock
0201 08:59:41.437826 (+ 48us) write_op.cc:341] FINISH: Updating metrics
0201 08:59:41.438545 (+ 719us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:41.438575 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":94784,"apply.run_cpu_time_us":1899,"apply.run_wall_time_us":1899,"num_ops":1,"prepare.queue_time_us":113910,"prepare.run_cpu_time_us":8823,"prepare.run_wall_time_us":447625,"raft.queue_time_us":220717,"raft.run_cpu_time_us":16002,"raft.run_wall_time_us":63792,"replication_time_us":947886,"thread_start_us":555493,"threads_started":4,"wal-append.queue_time_us":82019}]]}
I20260201 08:59:41.642956 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:41.612066 18128 consensus_queue.cc:237] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.643361 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.643733 17283 raft_consensus.cc:2393] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:41.643910 17249 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.645238 18094 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.645612 18094 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.646037 18094 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.646903 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.649377 16960 catalog_manager.cc:5654] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 2 to 3, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 3 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:41.651166 18126 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.669409 18126 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.669816 18126 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.656658 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.671016 17282 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:41.671890 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.672412 17282 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
W20260201 08:59:41.638690 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 46082.6us
I20260201 08:59:41.673285 17248 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.673454 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.645685 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.673789 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.674057 18072 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.674582 18072 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.674975 18072 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.675714 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.674177 17279 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:41.677624 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.678946 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:41.679430 18093 consensus_queue.cc:1059] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:41.679000 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.680456 18093 raft_consensus.cc:3055] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:41.681368 18093 raft_consensus.cc:740] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:41.682512 18093 consensus_queue.cc:260] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.655637 18048 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.684167 18093 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.688329 17248 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.690150 18098 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.690529 18098 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.690887 18098 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.700517 17280 raft_consensus.cc:1240] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:41.701445 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:41.666754 17249 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.658318 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.705600 17848 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:41.661032 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.653743 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.709039 17285 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.664263 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:41.710602 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 61343.6us
I20260201 08:59:41.711560 17248 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.715699 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:41.655264 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.721629 18119 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260201 08:59:41.722354 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 119341us
I20260201 08:59:41.737634 17847 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:41.740512 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.742220 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.756371 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.756803 17842 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.757813 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.758378 17842 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.759173 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.760226 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.743885 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.660216 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.661074 17846 raft_consensus.cc:1240] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:41.657758 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:41.658318 17839 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:41.745831 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:41.632123 18117 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.657519 18106 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.673211 18125 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.775206 18106 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:41.775456 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:41.775487 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.776340 17839 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.776801 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.777482 18131 consensus_queue.cc:1059] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:41.778573 18131 raft_consensus.cc:3055] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:41.778863 18131 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:41.779718 18131 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.781159 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.776794 17177 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:41.784134 17176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:41.762378 17276 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.746646 18130 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.793426 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.794422 18130 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.796594 17277 raft_consensus.cc:1240] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:41.797662 18125 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:41.798528 17844 raft_consensus.cc:1240] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:41.801090 17845 raft_consensus.cc:1240] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:41.775701 18106 raft_consensus.cc:697] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:41.809540 18048 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.777452 17843 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:41.749325 17283 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:41.816553 17794 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.777474 17839 raft_consensus.cc:1240] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:41.825583 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.793375 18138 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.830479 17794 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.833992 17794 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.821130 18123 consensus_queue.cc:1048] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260201 08:59:41.808457 18099 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.875208 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:41.831341 18138 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.809777 18147 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.836632 17794 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.877722 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:41.883162 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 46612.8us
I20260201 08:59:41.884164 17794 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.831532 18125 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:41.831703 18131 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.885699 18123 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.851923 18130 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:41.835781 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:41.833221 18119 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:41.890769 17101 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:41.882550 18147 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.889851 18123 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.899181 18147 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.899237 18123 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.883586 18138 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.838513 18129 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.894539 17175 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:41.809765 18106 consensus_queue.cc:237] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:41.900503 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 233816us
W20260201 08:59:41.904819 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 80289.9us
I20260201 08:59:41.875521 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:41.902983 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 114150us
I20260201 08:59:41.907352 17249 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.910284 17101 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:41.893404 18130 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.912945 17175 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:41.900739 17280 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.903482 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:41.919154 17204 raft_consensus.cc:1240] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:41.917990 17175 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.882181 17790 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:41.904320 18125 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.908891 18133 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.914496 18130 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:41.905893 18126 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:41.915982 18114 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:41.915812 18139 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.909373 18088 consensus_queue.cc:1059] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260201 08:59:41.925848 18085 raft_consensus.cc:2749] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:41.909705 18098 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:41.919656 18120 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.914332 18092 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:41.914043 18112 consensus_queue.cc:1059] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260201 08:59:41.940896 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 244118us
I20260201 08:59:41.941260 17175 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:41.947778 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 63669.9us
I20260201 08:59:41.965423 17794 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.938386 17177 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:41.936661 17277 raft_consensus.cc:2393] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:41.935343 18117 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.936019 18133 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:41.967525 17248 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:41.935703 18125 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.916033 18087 consensus_queue.cc:1059] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260201 08:59:41.936744 18139 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:41.918824 18121 consensus_queue.cc:1059] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260201 08:59:41.971192 17248 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:41.930002 18099 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:41.937362 18093 consensus_queue.cc:1059] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260201 08:59:41.931438 17204 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc"
dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:45104
I20260201 08:59:42.033455 17204 raft_consensus.cc:606] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:42.033787 17204 raft_consensus.cc:614] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:42.037772 18087 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.038549 18087 raft_consensus.cc:3055] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.038882 18087 raft_consensus.cc:740] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:42.039711 18087 consensus_queue.cc:260] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:42.030087 18118 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:41.951025 18120 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
W20260201 08:59:42.046264 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 107949us
I20260201 08:59:42.051620 17177 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:41.923815 18097 consensus_queue.cc:1059] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260201 08:59:41.970026 18133 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.024382 18125 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.031666 18139 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:41.966717 18119 consensus_queue.cc:1059] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260201 08:59:42.086377 17177 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.054659 18120 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.090809 17177 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.041424 18129 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.041699 18118 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.041308 18087 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.043359 18126 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:42.057967 18072 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.090533 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.101019 17175 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.102255 17177 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.029497 18094 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:42.105348 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 198057us
I20260201 08:59:42.087813 18117 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:42.040841 18123 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.102309 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.120306 18123 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.121025 18123 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:42.121325 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:42.122037 17283 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:42.122119 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 250035us
I20260201 08:59:42.103962 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.124981 17845 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:42.125053 17790 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.092625 18116 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.088258 18148 raft_consensus.cc:2804] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.040781 18130 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:42.131673 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 160537us
I20260201 08:59:42.104557 18100 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.104961 18093 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.101645 18118 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.134050 17249 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:42.109899 18085 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260201 08:59:42.157346 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 52347.3us
I20260201 08:59:42.160303 17248 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:42.139416 18117 raft_consensus.cc:697] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:42.162431 17790 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.121402 18123 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.163075 18094 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.133486 18097 raft_consensus.cc:3055] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:42.135268 18148 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:42.165269 18085 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.166293 17175 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.134156 18116 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.173749 17248 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.169612 18119 consensus_queue.cc:1243] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer f5398ba4a58b40ca9b78a210cdb7ae4d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260201 08:59:42.101485 18153 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:42.169768 18154 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:42.175318 18123 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.176807 18126 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.178946 18148 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.177134 18097 raft_consensus.cc:740] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:42.201349 18085 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.242358 18120 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.243584 17204 raft_consensus.cc:1240] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.244465 18120 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.240618 18118 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.205201 18116 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.172889 18138 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.205849 18167 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.208197 18154 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.207943 18119 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.208696 18092 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.207185 18098 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.217605 18072 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.285672 18163 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.286799 17248 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.225122 18126 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:42.225755 18155 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 08:59:42.278945 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 70445.7us
I20260201 08:59:42.289786 17101 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:42.281888 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 114090us
I20260201 08:59:42.296825 17249 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:42.279943 18154 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.273221 18167 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:42.300153 17249 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.288605 18072 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.303406 18092 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:42.297783 18173 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:42.315840 17250 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.299000 18130 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.319530 17249 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.280398 18117 consensus_queue.cc:237] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.299192 18126 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:42.321362 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 118389us
I20260201 08:59:42.299738 18175 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.305351 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.337329 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.336898 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.329010 18097 consensus_queue.cc:260] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.330386 17250 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.343704 17250 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:42.331530 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 169185us
I20260201 08:59:42.333436 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.320997 18092 raft_consensus.cc:697] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:42.307039 18167 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:42.336535 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 170319us
I20260201 08:59:42.298518 18161 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260201 08:59:42.341835 18072 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.313418 18147 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.353608 17210 raft_consensus.cc:1240] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:42.337931 18118 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.358911 17175 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.340410 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:42.360430 18119 consensus_queue.cc:1059] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260201 08:59:42.361083 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 58016.2us
I20260201 08:59:42.361419 18119 consensus_queue.cc:1243] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer f5398ba4a58b40ca9b78a210cdb7ae4d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260201 08:59:42.362258 17101 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.350132 18094 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.363324 17101 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.363935 17207 raft_consensus.cc:1240] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.365803 18092 consensus_queue.cc:237] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:42.366251 18133 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.352013 18129 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260201 08:59:42.370357 17232 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef0e0 after lost signal to thread 14092
I20260201 08:59:42.334331 18172 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.370775 18130 consensus_queue.cc:1059] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:42.373068 18179 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.373423 18121 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:42.373808 18148 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.376235 18138 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:42.357981 18072 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.364974 18094 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.363857 18097 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.368696 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.388517 18121 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 08:59:42.382216 17232 debug-util.cc:398] Leaking SignalData structure 0x7b0800041020 after lost signal to thread 16994
I20260201 08:59:42.396101 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.398612 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.398732 17128 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:42.407666 17128 raft_consensus.cc:606] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:42.363848 17790 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.399484 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.407814 17137 raft_consensus.cc:1275] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:42.362085 18098 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260201 08:59:42.408771 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 53758.7us
I20260201 08:59:42.409353 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.409533 18153 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.378716 18129 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.411105 18129 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.379984 18133 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.404594 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.409376 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.380160 18180 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.410560 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.392967 18130 consensus_queue.cc:1243] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer f5398ba4a58b40ca9b78a210cdb7ae4d log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260201 08:59:42.399703 18103 raft_consensus.cc:3055] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:42.401250 18072 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:42.418251 17232 debug-util.cc:398] Leaking SignalData structure 0x7b080014a760 after lost signal to thread 17161
I20260201 08:59:42.418546 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.406111 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.412472 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.410534 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.402873 18094 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.423386 18103 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:42.409600 17790 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.376804 18126 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.406038 18121 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:42.426266 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 80339.7us
W20260201 08:59:42.427551 17232 debug-util.cc:398] Leaking SignalData structure 0x7b080033f940 after lost signal to thread 17235
W20260201 08:59:42.443166 17232 debug-util.cc:398] Leaking SignalData structure 0x7b0800107640 after lost signal to thread 17309
W20260201 08:59:42.444330 17232 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca760 after lost signal to thread 17873
I20260201 08:59:42.428546 17174 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.408414 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.429414 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.450949 17250 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.452548 17845 raft_consensus.cc:3055] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.454672 17845 raft_consensus.cc:740] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:42.437865 17131 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:42.443154 17842 raft_consensus.cc:2393] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:42.453377 17174 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.441252 18112 raft_consensus.cc:993] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:42.461483 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.442728 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.457326 18118 consensus_queue.cc:1048] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260201 08:59:42.467504 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.450558 18130 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.469841 17842 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.470394 17847 raft_consensus.cc:1240] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.471002 18139 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.472752 17210 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:42.469489 18123 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.478672 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.455488 17841 raft_consensus.cc:3055] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:42.479373 17209 raft_consensus.cc:1240] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.463382 18173 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.480330 17841 raft_consensus.cc:740] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:42.487949 17841 consensus_queue.cc:260] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.489262 17841 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:42.461910 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 52406.7us
I20260201 08:59:42.496588 17207 raft_consensus.cc:1240] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.498194 17208 raft_consensus.cc:1240] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.502266 18088 raft_consensus.cc:3055] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.502673 18088 raft_consensus.cc:740] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:42.472606 17131 raft_consensus.cc:606] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Received request to transfer leadership to TS f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.452014 18188 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.507932 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.484624 18147 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.472277 18160 raft_consensus.cc:1081] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:42.500341 18103 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.513680 18103 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.506574 18088 consensus_queue.cc:260] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.457415 18125 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:42.511399 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 60545.6us
I20260201 08:59:42.514739 17284 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.526623 17285 raft_consensus.cc:1240] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.529376 18116 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:42.515769 18109 consensus_queue.cc:1175] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35484ac93d564e958f85965bd740a18f" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 08:59:42.532840 18116 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:42.507311 18126 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.517285 17790 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.537708 17131 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:42.538805 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.540292 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.541246 18159 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.541536 18121 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.542435 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.464090 17845 consensus_queue.cc:260] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.571411 18095 raft_consensus.cc:3055] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:42.524628 17283 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:42.518052 17250 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:42.573071 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 101453us
W20260201 08:59:42.575878 17280 consensus_meta.cc:287] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.639s user 0.005s sys 0.012s
I20260201 08:59:42.597132 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.572510 17848 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.574635 17847 raft_consensus.cc:1240] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.543085 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.516085 18193 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:42.597937 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 76743.4us
I20260201 08:59:42.577237 18153 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.600667 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.601357 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.601824 17840 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39018
I20260201 08:59:42.602420 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.594993 18159 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.603232 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:42.573707 17284 raft_consensus.cc:1240] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.601419 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.605093 17794 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:42.605582 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.606626 17250 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.607502 17177 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.610049 17177 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.598616 17280 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:42.611745 18099 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.612470 17794 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:42.613013 18098 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.615789 18182 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:42.594828 18155 raft_consensus.cc:2764] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260201 08:59:42.575805 18176 consensus_queue.cc:1059] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260201 08:59:42.628897 18156 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.629338 17278 raft_consensus.cc:1240] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.613469 18153 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:42.630115 18153 raft_consensus.cc:697] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:42.602423 17840 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:42.630304 18118 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.630657 17840 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.617612 18085 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.595023 18088 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.621762 18123 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.622766 18093 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.623196 18159 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:42.592034 18095 raft_consensus.cc:740] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:42.593712 18160 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.609239 18117 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260201 08:59:42.594120 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 84030.1us
I20260201 08:59:42.629166 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.621189 18129 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.633340 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.595166 18154 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.634989 18072 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.636332 17177 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:42.601819 17279 raft_consensus.cc:1240] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.658610 18087 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.659004 18087 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.659390 18087 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.659219 18095 consensus_queue.cc:260] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.661089 18095 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.663197 18094 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.625118 18116 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:42.665053 18116 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:42.665460 18116 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:42.666298 18129 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.643056 18160 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.670428 17284 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.671100 18176 raft_consensus.cc:993] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower f97c64e8acf34ae28a520dd40fc5281c to start an election
I20260201 08:59:42.646265 18150 raft_consensus.cc:3055] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.671626 18176 raft_consensus.cc:1081] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Signalling peer f97c64e8acf34ae28a520dd40fc5281c to start an election
I20260201 08:59:42.645007 16960 catalog_manager.cc:5654] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 3 to 4, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 4 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:42.631884 18188 consensus_queue.cc:1059] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260201 08:59:42.630834 18118 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.678009 17790 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.644268 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:42.647957 18139 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.666965 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:42.641290 18173 consensus_queue.cc:1059] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260201 08:59:42.671542 18160 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:42.676534 17281 raft_consensus.cc:2393] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:42.677404 18188 raft_consensus.cc:3055] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.700330 18188 raft_consensus.cc:740] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:42.681334 18163 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.700922 18163 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:42.701157 18188 consensus_queue.cc:260] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:42.702325 18188 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.702886 18163 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:42.637162 18175 consensus_queue.cc:1059] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260201 08:59:42.710994 18175 raft_consensus.cc:3055] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.711360 18175 raft_consensus.cc:740] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:42.714176 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.715747 17279 raft_consensus.cc:1240] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.679162 18118 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:42.716960 17103 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:42.717850 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 69020.6us
I20260201 08:59:42.718237 18121 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.718541 17103 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.718884 18121 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.671845 18150 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:42.671917 18072 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.689011 18189 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.689546 18153 consensus_queue.cc:237] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.691432 18167 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.692200 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:42.725646 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.692847 17282 raft_consensus.cc:1240] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.742568 17103 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.644889 18156 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.694515 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.695935 18154 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.696377 18125 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.681917 18123 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.692900 18085 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:42.698918 17845 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.699177 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:42.700001 18191 log.cc:927] Time spent T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.098s user 0.001s sys 0.000s
I20260201 08:59:42.654275 18182 raft_consensus.cc:697] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:42.704643 18132 raft_consensus.cc:3055] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.759356 18132 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:42.759783 18182 consensus_queue.cc:237] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.706084 17841 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260201 08:59:42.707814 17177 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:42.708717 17100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:42.763656 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.708961 18148 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.720199 17279 raft_consensus.cc:3055] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:42.712170 18175 consensus_queue.cc:260] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.770116 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.771283 17202 raft_consensus.cc:1240] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:42.771458 18175 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:42.772543 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:42.701330 17276 raft_consensus.cc:1240] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.703487 18094 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.746382 17103 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.747550 17102 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:42.783520 17100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:42.756253 17844 raft_consensus.cc:1240] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.757822 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.758963 17280 raft_consensus.cc:1240] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.751422 18133 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.705302 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:42.750113 18176 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.679349 17790 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.760190 18132 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:42.763157 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.755198 17281 raft_consensus.cc:2393] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:42.765105 17841 pending_rounds.cc:85] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Aborting all ops after (but not including) 2
I20260201 08:59:42.770046 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.770437 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.769181 17279 raft_consensus.cc:740] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:42.770699 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.776532 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.776821 17285 raft_consensus.cc:1240] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.777186 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.777755 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.778321 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.770685 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:42.778901 17283 raft_consensus.cc:1240] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.758278 18150 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:42.781170 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 73425.4us
I20260201 08:59:42.757874 18156 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:42.792486 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 46182.9us
I20260201 08:59:42.793421 17134 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:42.750298 18116 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.795778 17284 raft_consensus.cc:1240] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.790094 18198 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260201 08:59:42.797833 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.763764 18118 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.801857 18196 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.802165 18132 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.802492 17841 pending_rounds.cc:107] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260201 08:59:42.803268 17281 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.794431 18103 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.803076 17279 consensus_queue.cc:260] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.782802 18124 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.794852 18114 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.811888 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:42.824369 17177 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.827109 17103 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.819270 18125 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.836346 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:42.831964 18150 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.865896 17279 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:42.866231 17134 raft_consensus.cc:1240] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.874841 17133 raft_consensus.cc:1240] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
W20260201 08:59:42.880712 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 53703.7us
I20260201 08:59:42.832500 17841 raft_consensus.cc:2889] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:42.881513 17103 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.887463 17103 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.888746 17103 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:42.832451 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 153193us
I20260201 08:59:42.889990 18088 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.865572 18085 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.908030 17103 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:42.881331 17277 raft_consensus.cc:1240] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.880625 17131 raft_consensus.cc:606] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:42.898378 17840 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.901714 18114 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.901338 18156 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.902052 18196 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:42.918377 17206 raft_consensus.cc:1240] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.877729 18139 consensus_queue.cc:1059] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260201 08:59:42.874042 18103 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.865896 18118 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:42.909859 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.925977 17843 raft_consensus.cc:1240] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.890213 18176 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260201 08:59:42.923136 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:42.912410 17131 raft_consensus.cc:614] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:42.912791 17276 raft_consensus.cc:1240] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.928164 18180 consensus_queue.cc:1059] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:42.916507 18121 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:42.912029 18163 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:42.897545 18087 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:42.914983 18106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s user 0.040s sys 0.059s
I20260201 08:59:42.916359 18095 consensus_queue.cc:1059] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260201 08:59:42.920827 18158 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260201 08:59:42.919101 18167 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:42.909221 18097 consensus_queue.cc:1059] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260201 08:59:42.939481 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:42.939563 18184 consensus_queue.cc:1059] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260201 08:59:42.942162 17128 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
W20260201 08:59:42.935052 18106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s user 0.041s sys 0.060s
I20260201 08:59:42.946367 18165 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260201 08:59:42.953274 17205 raft_consensus.cc:1240] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.945658 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:42.948200 17175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:42.919293 17790 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:42.961234 17848 raft_consensus.cc:2393] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
W20260201 08:59:42.954975 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:42.937877 18163 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:42.955583 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:42.975386 17839 raft_consensus.cc:1240] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:42.976050 17842 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:42.954039 18109 consensus_queue.cc:1059] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260201 08:59:42.922267 18159 consensus_queue.cc:1059] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260201 08:59:42.963603 18125 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:42.977236 18125 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:42.977605 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:42.967710 17249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:42.979161 17280 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:42.969102 18103 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:42.981429 18133 raft_consensus.cc:3055] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:42.981863 18133 raft_consensus.cc:740] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:42.982656 18133 consensus_queue.cc:260] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:42.983826 18133 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:42.969463 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:42.971050 18087 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:42.972432 17845 raft_consensus.cc:1275] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:59:42.973111 18116 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:42.990680 17845 pending_rounds.cc:85] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Aborting all ops after (but not including) 1
I20260201 08:59:43.003130 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:43.026815 17202 raft_consensus.cc:2393] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:43.027865 17839 raft_consensus.cc:1275] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:42.988767 17285 raft_consensus.cc:1240] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.006047 18177 raft_consensus.cc:3055] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.030575 18177 raft_consensus.cc:740] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.031435 18177 consensus_queue.cc:260] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:42.999255 18167 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:42.985980 18179 consensus_queue.cc:1059] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:42.979187 18125 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:43.032843 18167 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:43.033412 18167 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:43.032756 18177 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.037736 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:43.021183 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 83210us
I20260201 08:59:43.038944 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.037963 18160 raft_consensus.cc:3055] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.040537 18160 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.039980 17279 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:59:43.041584 17279 pending_rounds.cc:85] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Aborting all ops after (but not including) 1
I20260201 08:59:43.041863 17279 pending_rounds.cc:107] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:43.042268 17279 raft_consensus.cc:2889] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260201 08:59:43.020419 18202 log.cc:927] Time spent T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260201 08:59:43.045224 17847 raft_consensus.cc:1240] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:43.038234 17845 pending_rounds.cc:107] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:43.042567 18116 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:43.052217 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 67095.5us
I20260201 08:59:43.052743 17250 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.055177 17250 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.055966 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:43.056507 17279 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
W20260201 08:59:43.054265 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 113163us
W20260201 08:59:43.043926 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 132772us
I20260201 08:59:43.061182 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:43.049137 17845 raft_consensus.cc:2889] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:43.067416 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:43.067699 17840 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:43.068543 18196 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:43.069075 18196 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.070909 18196 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:43.062609 18127 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:43.071830 18121 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:43.068578 18199 consensus_queue.cc:1059] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260201 08:59:43.053946 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.080158 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:43.062387 18088 consensus_queue.cc:1059] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260201 08:59:43.081337 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.082007 18163 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:43.082816 18150 consensus_queue.cc:1059] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:43.081035 17280 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54632
I20260201 08:59:43.083662 17280 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:43.083784 18103 raft_consensus.cc:3055] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.084074 17280 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:43.084195 18103 raft_consensus.cc:740] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.062142 18178 consensus_queue.cc:1059] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260201 08:59:43.085153 18178 raft_consensus.cc:3055] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.085597 18178 raft_consensus.cc:740] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.085752 18160 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:43.086421 18178 consensus_queue.cc:260] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.086892 18072 consensus_queue.cc:1048] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:43.059944 18149 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.081022 18109 consensus_queue.cc:1059] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:43.075469 17248 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.060322 18154 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.063161 18126 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260201 08:59:43.092754 17790 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.097100 18118 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:43.098315 17790 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.057808 18175 consensus_queue.cc:1059] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260201 08:59:43.099562 17790 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.100383 18123 raft_consensus.cc:2804] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:43.100767 18123 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:43.101017 18125 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260201 08:59:43.101660 18119 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260201 08:59:43.107911 18159 raft_consensus.cc:3055] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.108331 17174 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:43.101181 18123 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.111528 18097 consensus_queue.cc:1059] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:43.111953 18138 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:43.085004 18103 consensus_queue.cc:260] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.067473 18179 raft_consensus.cc:3055] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.092265 18156 raft_consensus.cc:3055] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.113224 18179 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.113356 18163 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.113653 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:43.114164 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.114064 18179 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.114559 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.114856 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:43.109529 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.115134 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.061509 18116 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.115607 18156 raft_consensus.cc:740] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.116452 17205 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:43.117101 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.117347 18116 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:43.118136 18139 consensus_queue.cc:1048] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:43.118476 17174 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.118716 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:43.119323 17845 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:43.102340 18198 raft_consensus.cc:3055] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.120213 18198 raft_consensus.cc:740] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.115445 17136 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:43.121625 17174 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:43.090525 17204 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
W20260201 08:59:43.095278 17251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.103894 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.104748 17135 raft_consensus.cc:1240] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:43.071785 18184 consensus_queue.cc:1059] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260201 08:59:43.126828 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.122265 17175 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:43.133112 18166 raft_consensus.cc:3055] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.133533 18166 raft_consensus.cc:740] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.122313 17136 raft_consensus.cc:606] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:43.085068 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:43.133553 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.083814 18150 raft_consensus.cc:3055] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.093444 18127 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260201 08:59:43.101719 18158 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.137048 17208 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:43.108299 18159 raft_consensus.cc:740] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.146394 18150 raft_consensus.cc:740] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.152752 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.154240 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.153946 18150 consensus_queue.cc:260] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:43.155711 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 52997.9us
W20260201 08:59:43.155946 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 80553.5us
I20260201 08:59:43.119246 18180 raft_consensus.cc:3055] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:43.144317 18165 raft_consensus.cc:3055] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:43.159125 17136 raft_consensus.cc:1275] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:43.128775 18087 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.166116 17248 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:43.167294 17248 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:43.170907 18129 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.171080 17248 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.173616 18149 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.174424 17174 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.176038 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.113379 18138 consensus_queue.cc:1059] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260201 08:59:43.149238 18132 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.100777 17790 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.179203 17248 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:43.182164 17793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.164805 18180 raft_consensus.cc:740] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.188694 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.145001 18163 consensus_queue.cc:1059] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260201 08:59:43.189734 17248 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.162413 18165 raft_consensus.cc:740] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.189361 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.168674 18099 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.168238 18188 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:43.149610 18199 consensus_queue.cc:1059] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260201 08:59:43.193393 17177 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.193347 17248 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.194643 17174 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.179035 18150 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.195709 17248 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.197438 17133 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:43.198009 17133 raft_consensus.cc:606] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:43.198395 17133 raft_consensus.cc:614] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:43.185820 18118 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:43.158888 18166 consensus_queue.cc:260] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.188993 18129 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:43.191730 18124 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.207751 17103 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.181519 18133 consensus_queue.cc:1059] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260201 08:59:43.209173 17103 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.197263 18182 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.211329 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.197208 18188 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:43.199720 18117 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.210132 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.199290 18189 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.182917 18085 consensus_queue.cc:1059] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260201 08:59:43.198943 18167 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.206652 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260201 08:59:43.203405 18118 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:43.204504 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.204556 18121 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:43.218430 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:43.183671 18198 consensus_queue.cc:260] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:43.205878 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 103067us
I20260201 08:59:43.212883 18088 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.202431 18170 consensus_queue.cc:1059] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260201 08:59:43.215636 18133 consensus_queue.cc:1243] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer 35484ac93d564e958f85965bd740a18f log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260201 08:59:43.214417 18188 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:43.215456 18184 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.225673 18139 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:43.239715 18138 raft_consensus.cc:3055] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.303160 18138 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.303392 18100 raft_consensus.cc:3055] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.236961 18180 consensus_queue.cc:260] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:43.304594 18180 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:43.304306 18165 consensus_queue.cc:260] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.305783 18165 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:43.306212 18159 consensus_queue.cc:260] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.307379 18159 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.310168 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:43.311141 18195 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.312134 18186 consensus_queue.cc:1059] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.167s
I20260201 08:59:43.313774 18199 raft_consensus.cc:3055] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.314133 18199 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.302639 18162 raft_consensus.cc:3055] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.315641 18162 raft_consensus.cc:740] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.316468 18162 consensus_queue.cc:260] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.317682 18162 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.303823 18100 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.227986 18164 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.259496 18121 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.236016 18118 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.314882 18199 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.211757 18193 consensus_queue.cc:1048] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260201 08:59:43.295915 17103 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.331678 17207 raft_consensus.cc:2468] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:43.340875 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.341689 17135 raft_consensus.cc:2393] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:43.342190 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.344597 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:43.351356 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 156761us
I20260201 08:59:43.328713 18166 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:43.319890 18133 consensus_queue.cc:1175] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f97c64e8acf34ae28a520dd40fc5281c" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260201 08:59:43.356232 18156 consensus_queue.cc:260] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:43.359570 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.353724 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.364110 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.366465 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.344781 18095 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.369715 17135 raft_consensus.cc:1240] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:43.373304 17250 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:43.374577 17250 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:43.375459 18100 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.376663 18100 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.377390 17204 raft_consensus.cc:1240] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.378593 17210 raft_consensus.cc:1240] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.385159 17209 raft_consensus.cc:1240] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.387266 17102 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.394788 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.388139 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:43.401655 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 208293us
I20260201 08:59:43.388321 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:43.370748 18153 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 08:59:43.414175 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.394346 18155 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:43.393247 18189 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:43.388598 18199 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.386962 18098 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260201 08:59:43.423220 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.424230 17177 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.402964 18217 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.425485 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.427183 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:43.403512 17128 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:43.410455 18167 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:43.381249 18138 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:43.435055 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.421401 18155 raft_consensus.cc:697] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
W20260201 08:59:43.421546 18205 log.cc:927] Time spent T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.217s user 0.000s sys 0.001s
I20260201 08:59:43.441705 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.437969 17136 raft_consensus.cc:2368] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:43.429955 18189 raft_consensus.cc:697] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:43.448809 17248 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:43.449611 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.431116 18210 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:43.418287 18153 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.463130 18121 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:43.468005 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.457243 18123 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.470647 18123 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:43.473482 17790 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.473719 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:43.467126 17250 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:43.481989 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:43.455621 18195 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:43.444038 18155 consensus_queue.cc:237] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.489084 18175 raft_consensus.cc:3055] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:43.489519 18175 raft_consensus.cc:740] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.479617 18123 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.475232 17790 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.496381 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.499897 17845 raft_consensus.cc:1240] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:43.490265 18175 consensus_queue.cc:260] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:43.510164 17133 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:43.480216 18189 consensus_queue.cc:237] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.499435 18048 raft_consensus.cc:2804] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:43.514992 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.515785 17133 raft_consensus.cc:2393] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:43.538753 18163 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:43.541841 17839 raft_consensus.cc:1240] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:43.505663 18118 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.508046 17130 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
W20260201 08:59:43.520224 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 45071us
I20260201 08:59:43.491251 17280 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.509804 18167 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 08:59:43.545776 17176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.541324 18048 raft_consensus.cc:697] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:43.553740 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.554978 18118 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:43.542431 18163 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.563577 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:43.556634 17136 raft_consensus.cc:1240] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:43.558568 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:43.553040 17209 raft_consensus.cc:1240] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.521247 18087 consensus_queue.cc:1059] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260201 08:59:43.567515 17790 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.568380 18048 consensus_queue.cc:237] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.568945 18163 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:43.571038 17207 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:43.572328 17285 raft_consensus.cc:1240] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 3. Ops: []
I20260201 08:59:43.573374 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.575798 17790 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.577013 17790 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.578050 17280 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:43.578270 18182 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.578898 18182 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.579586 18152 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.583554 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:43.584228 17843 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:43.592890 17175 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:43.593113 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.593822 17278 raft_consensus.cc:2393] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:43.594218 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.588639 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.602208 17134 raft_consensus.cc:2393] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:43.582996 18167 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:43.621064 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.621691 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.596221 18153 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:43.603678 18164 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:43.578117 17790 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:43.637549 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 59531.5us
I20260201 08:59:43.638195 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.638983 17128 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
W20260201 08:59:43.641891 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.642928 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.633822 18164 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:43.649415 18164 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:43.641562 17280 raft_consensus.cc:1240] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:43.643929 17790 leader_election.cc:400] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:43.643814 18153 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:43.668363 17100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.670219 17128 raft_consensus.cc:1240] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:43.670274 17134 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:43.650763 18188 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.678229 18151 raft_consensus.cc:3055] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.682017 18198 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:43.681210 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 290351us
I20260201 08:59:43.689666 18127 consensus_queue.cc:1059] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260201 08:59:43.706552 17793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.690590 18151 raft_consensus.cc:740] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.715291 17202 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:43.696609 17131 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:43.698340 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:43.729825 17210 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:43.675284 17790 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.716195 18095 consensus_queue.cc:1059] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
W20260201 08:59:43.731523 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 61663.3us
I20260201 08:59:43.731905 18095 raft_consensus.cc:3055] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.732347 17790 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.732350 18095 raft_consensus.cc:740] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:43.731979 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:43.712212 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.751829 17134 raft_consensus.cc:1240] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.755961 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:43.763430 18095 consensus_queue.cc:260] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:43.765763 18095 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.736021 18182 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:43.771371 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.771683 17210 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:43.736202 18125 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:43.733422 18087 consensus_queue.cc:1059] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260201 08:59:43.778270 18164 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.782655 18164 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:43.783833 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:43.784516 17842 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 4
W20260201 08:59:43.793157 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 118963us
I20260201 08:59:43.792544 17842 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
W20260201 08:59:43.810204 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 137155us
I20260201 08:59:43.813246 18095 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:43.820626 17175 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:43.825556 18179 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.826854 17793 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:43.806473 18195 raft_consensus.cc:697] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:43.834159 18182 raft_consensus.cc:697] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:43.835247 18182 consensus_queue.cc:237] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:43.825798 18132 raft_consensus.cc:3055] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:43.839627 18132 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:43.849471 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:43.816884 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 44018.8us
I20260201 08:59:43.842774 18125 raft_consensus.cc:2764] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260201 08:59:43.840448 18132 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:43.901530 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 55250.4us
I20260201 08:59:43.848511 18118 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election won for term 4
W20260201 08:59:43.907620 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 49575.4us
I20260201 08:59:43.855942 18188 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:43.918795 17207 raft_consensus.cc:1240] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.807499 18151 consensus_queue.cc:260] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:43.925655 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:43.926224 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:43.927443 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:43.928285 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:43.931720 18173 raft_consensus.cc:3055] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:43.932157 18173 raft_consensus.cc:740] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:43.926314 17278 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
W20260201 08:59:43.937307 17176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.911155 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:43.943909 17131 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:43.946960 17248 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:43.921613 18118 raft_consensus.cc:697] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:43.954097 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:43.952659 17282 raft_consensus.cc:1240] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.951259 18132 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:43.924492 18195 consensus_queue.cc:237] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:43.924127 18131 consensus_queue.cc:1175] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3dee892ea94d4f2a92316ad6f79edca2" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 08:59:43.916605 17790 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:43.924822 18127 consensus_queue.cc:1059] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260201 08:59:43.967813 18239 log.cc:927] Time spent T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260201 08:59:43.972816 17841 raft_consensus.cc:1240] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:43.976107 18118 consensus_queue.cc:237] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.982184 18123 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:43.960945 18149 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:43.932992 18173 consensus_queue.cc:260] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:43.997998 18133 raft_consensus.cc:993] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:43.998627 18133 raft_consensus.cc:1081] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:44.001067 18182 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.001399 18246 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260201 08:59:44.000922 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 96427.1us
I20260201 08:59:44.002152 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.002561 17790 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.003340 18199 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:44.003919 17790 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:44.001636 18182 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:44.005023 18125 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:44.005450 17177 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.005671 18125 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:44.006856 18127 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.004639 18162 raft_consensus.cc:3055] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:44.009454 18127 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.009974 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:44.010241 18175 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.007284 18182 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.011570 18127 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.012042 18162 raft_consensus.cc:740] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:44.012921 18162 consensus_queue.cc:260] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.013751 18178 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.014065 18162 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.015297 18199 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:44.016117 18149 raft_consensus.cc:697] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:44.018898 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:44.019690 17278 raft_consensus.cc:2393] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:44.017329 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.021418 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.021481 17207 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:44.023669 17282 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:44.024230 17793 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.017045 18149 consensus_queue.cc:237] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:44.009573 18233 log.cc:927] Time spent T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260201 08:59:44.041067 18151 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.046643 18167 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.035918 18182 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:44.051482 18182 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.051848 18182 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.069049 18160 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.047993 18103 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:43.991989 18168 consensus_queue.cc:1059] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260201 08:59:44.087393 17136 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.052881 18186 consensus_queue.cc:1059] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260201 08:59:44.093889 17209 raft_consensus.cc:1275] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:44.095485 17100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.070959 18167 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:44.053232 17790 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.100282 18138 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.101539 18117 consensus_queue.cc:1048] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:44.106915 17205 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.113698 16960 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51064 (request call id 148) took 1986 ms. Trace:
I20260201 08:59:44.092432 18106 consensus_queue.cc:1059] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260201 08:59:44.121167 18152 consensus_queue.cc:1059] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260201 08:59:44.124889 18246 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260201 08:59:44.129280 18247 log.cc:927] Time spent T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.088s user 0.000s sys 0.001s
W20260201 08:59:44.132562 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 99137.5us
I20260201 08:59:44.151762 17204 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.129109 17845 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.123310 16960 rpcz_store.cc:276] 0201 08:59:42.123442 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:42.123590 (+ 148us) service_pool.cc:225] Handling call
0201 08:59:44.109672 (+1986082us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 08:59:42.930489 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 08:59:42.953643 (+ 23154us) write_op.cc:432] Acquiring schema lock in shared mode
0201 08:59:42.953679 (+ 36us) write_op.cc:435] Acquired schema lock
0201 08:59:42.953697 (+ 18us) tablet.cc:660] Decoding operations
0201 08:59:42.974694 (+ 20997us) write_op.cc:620] Acquiring the partition lock for write op
0201 08:59:42.988746 (+ 14052us) write_op.cc:641] Partition lock acquired for write op
0201 08:59:43.013628 (+ 24882us) tablet.cc:683] Acquiring locks for 1 operations
0201 08:59:43.046048 (+ 32420us) tablet.cc:699] Row locks acquired
0201 08:59:43.046600 (+ 552us) write_op.cc:260] PREPARE: finished
0201 08:59:43.054294 (+ 7694us) write_op.cc:270] Start()
0201 08:59:43.063552 (+ 9258us) write_op.cc:276] Timestamp: P: 1769936383052489 usec, L: 0
0201 08:59:43.065996 (+ 2444us) op_driver.cc:348] REPLICATION: starting
0201 08:59:43.100127 (+ 34131us) log.cc:844] Serialized 540 byte log entry
0201 08:59:43.440764 (+340637us) op_driver.cc:464] REPLICATION: finished
0201 08:59:43.571722 (+130958us) write_op.cc:301] APPLY: starting
0201 08:59:43.579161 (+ 7439us) tablet.cc:1365] starting BulkCheckPresence
0201 08:59:43.591794 (+ 12633us) tablet.cc:1368] finished BulkCheckPresence
0201 08:59:43.620825 (+ 29031us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 08:59:43.625287 (+ 4462us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 08:59:43.627207 (+ 1920us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0201 08:59:43.627252 (+ 45us) write_op.cc:312] APPLY: finished
0201 08:59:43.627485 (+ 233us) log.cc:844] Serialized 22 byte log entry
0201 08:59:43.627654 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:43.627736 (+ 82us) write_op.cc:454] Released schema lock
0201 08:59:43.627775 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0201 08:59:43.628133 (+ 358us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:43.628162 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":120356,"apply.run_cpu_time_us":2201,"apply.run_wall_time_us":63539,"num_ops":1,"prepare.queue_time_us":234840,"prepare.run_cpu_time_us":42757,"prepare.run_wall_time_us":279164,"raft.queue_time_us":133567,"raft.run_cpu_time_us":7760,"raft.run_wall_time_us":28468,"replication_time_us":374617,"thread_start_us":410919,"threads_started":4,"wal-append.queue_time_us":157862}]]}
I20260201 08:59:44.159576 17136 raft_consensus.cc:1275] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:44.172812 17102 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:44.160969 17100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.175468 17204 raft_consensus.cc:1275] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:44.181916 18195 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:44.190045 17209 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:44.192693 17207 raft_consensus.cc:1275] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:44.169028 17842 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.201699 18189 consensus_queue.cc:1059] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:44.202050 18167 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.204568 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.199546 18154 raft_consensus.cc:3055] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:44.198151 18217 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:44.220737 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:44.202699 17841 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39018
W20260201 08:59:44.235047 17793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.195941 17790 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.217412 18168 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.239126 17794 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.211009 18106 consensus_queue.cc:1048] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260201 08:59:44.231590 18154 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:44.232545 18217 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.216907 18243 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260201 08:59:44.253157 17100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.258072 18182 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:44.260409 18182 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.265185 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:44.266577 17278 raft_consensus.cc:1240] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:44.250252 18123 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:44.252430 18217 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.252620 17841 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:44.279284 17210 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:44.280591 17793 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.273784 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:44.282445 17285 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:44.288688 17102 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:44.249827 18168 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:44.265964 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 75665.6us
I20260201 08:59:44.276744 17841 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:44.305263 18156 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.276763 18154 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:44.291654 18123 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:44.309580 17842 raft_consensus.cc:1275] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:44.315040 18123 raft_consensus.cc:697] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:44.289398 18199 raft_consensus.cc:3055] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:44.316990 18103 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.312310 18160 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:44.326804 17135 raft_consensus.cc:1275] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:44.319706 18199 raft_consensus.cc:740] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:44.348500 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.321528 18243 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260201 08:59:44.328580 18160 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.372159 17135 raft_consensus.cc:1275] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:44.330348 18098 raft_consensus.cc:3055] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:44.352331 18163 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.376987 16957 catalog_manager.cc:5654] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 2, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:44.325129 18103 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:44.318504 18123 consensus_queue.cc:237] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:44.366636 18094 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:44.368937 18173 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.389843 16958 catalog_manager.cc:5654] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 08:59:44.391337 17285 raft_consensus.cc:1275] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:44.392150 16955 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34906 (request call id 58) took 1237 ms. Trace:
I20260201 08:59:44.393818 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:44.407534 18227 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.410318 17847 raft_consensus.cc:1275] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:44.395088 18168 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:44.395776 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:44.397853 18256 log.cc:927] Time spent T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.069s user 0.000s sys 0.001s
I20260201 08:59:44.406822 17132 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:44.375120 18160 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.413403 17285 raft_consensus.cc:1275] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:44.374918 18098 raft_consensus.cc:740] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:44.412112 16955 rpcz_store.cc:276] 0201 08:59:43.141997 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:43.142624 (+ 627us) service_pool.cc:225] Handling call
0201 08:59:43.376294 (+233670us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b540008f554. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a40c0 00007f74b0242bba 00007f74b5fc3eac 00007f74b60be10e 00007f74b45b94a4 00007f74b45b9432 00007f74b45b9361 00007f74b45b92dc 00007f74b45b8592 00007f74ae57934c 00007f74ae578786
0201 08:59:44.379570 (+1003276us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":115338,"reported_tablets":3,"spinlock_wait_cycles":116137216}
I20260201 08:59:44.425324 17282 raft_consensus.cc:1275] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:44.411648 17845 raft_consensus.cc:1275] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:44.420279 18085 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260201 08:59:44.445165 18167 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:44.429500 18175 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.446307 18175 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.448004 18114 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.448202 18175 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.420015 18246 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:44.410135 18227 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.448575 18114 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.450171 18227 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.413071 18127 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.431990 18098 consensus_queue.cc:260] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.450783 18127 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.412725 18199 consensus_queue.cc:260] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.453626 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.454345 17204 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.428198 18182 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260201 08:59:44.425927 17137 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:44.456897 17102 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.444289 17790 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.479810 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:44.386260 18163 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.502955 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.503667 17210 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.504823 17102 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.410595 18094 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.510617 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.493418 17129 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:44.511991 18127 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.513166 18163 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:44.513926 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:44.514451 18109 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:44.514899 18109 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.515241 18109 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.516757 17133 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:44.451298 18114 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:44.517639 18176 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.518251 17205 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.518093 18176 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:44.518509 18103 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:44.440284 17130 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:44.519429 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:44.519582 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.520150 17128 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:44.521188 18217 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.523100 18217 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.525128 18154 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:44.502475 18085 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.531132 18085 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.531949 18138 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.533073 18085 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.451371 18098 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.532465 18138 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.535120 18138 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.520196 17210 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.539104 17174 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.539151 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:44.539799 17135 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
W20260201 08:59:44.541096 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 112533us
I20260201 08:59:44.542759 17102 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.544085 17174 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.545225 17174 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:44.494679 18227 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.508761 18175 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:44.563730 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:44.567837 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 128284us
I20260201 08:59:44.570384 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:44.571297 17848 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.548952 18198 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:44.548935 18118 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:44.479449 18246 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:44.579897 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 145940us
I20260201 08:59:44.570333 18151 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:44.566452 18175 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:44.488917 18160 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.569672 18131 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:44.588652 17841 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.591955 18151 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:44.578598 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:44.598729 18175 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.586879 18118 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:44.579881 18198 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.562580 18227 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.609980 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:44.617698 17278 raft_consensus.cc:2393] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:44.618047 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.602656 18131 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:44.606909 18151 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.620826 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:44.619756 17207 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.623900 17282 raft_consensus.cc:2393] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:44.606845 18193 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.625191 17102 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.619652 17210 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.623888 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:44.627228 17285 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:44.614228 18123 consensus_queue.cc:1048] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260201 08:59:44.629209 17102 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.612633 18118 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.630339 17102 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.614748 18198 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:44.635180 17133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54340 (request call id 43) took 1163 ms. Trace:
I20260201 08:59:44.635639 17133 rpcz_store.cc:276] 0201 08:59:43.465719 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:43.623329 (+157610us) service_pool.cc:225] Handling call
0201 08:59:44.629223 (+1005894us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54001dced4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:44.629326 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1990755584}
I20260201 08:59:44.616530 18227 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:44.611325 17843 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:44.622686 18131 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:44.659837 17176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.630909 18127 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:44.668222 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:44.711848 18258 log.cc:927] Time spent T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.102s user 0.000s sys 0.000s
I20260201 08:59:44.689836 18117 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.636648 18162 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260201 08:59:44.720049 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 177019us
I20260201 08:59:44.629205 18193 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:44.718436 18127 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 08:59:44.811278 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 160340us
I20260201 08:59:44.635221 18103 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
W20260201 08:59:44.813375 17793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.637041 18189 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260201 08:59:44.821022 18224 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.821911 18234 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:44.825487 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 187658us
I20260201 08:59:44.812636 18260 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:44.823051 18262 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:44.832504 18127 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.826581 18162 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:44.834892 18094 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:44.842589 18224 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.826279 18117 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:44.852135 18263 consensus_queue.cc:1048] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260201 08:59:44.857656 18265 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:44.858975 18262 raft_consensus.cc:697] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:44.862821 18109 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.836621 18242 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:44.864540 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:44.865574 17132 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 306) took 1759 ms (client timeout 2068 ms). Trace:
I20260201 08:59:44.829200 17277 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:44.871225 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:44.847426 17840 raft_consensus.cc:1275] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:44.879161 18117 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:44.880740 18193 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:44.901685 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:44.914939 17101 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:44.870186 18162 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.896158 18163 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.892310 18127 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.931149 17136 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:44.930392 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:44.928812 18114 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:44.904091 18242 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:44.844878 18234 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:44.920760 17131 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:44.933661 18246 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:44.913960 18160 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:44.920305 18227 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.937630 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:44.947556 17204 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:44.898893 18265 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:44.939149 17174 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.965122 17136 raft_consensus.cc:606] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:44.968392 17136 raft_consensus.cc:614] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:44.952332 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:44.937522 18224 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:44.903896 17132 rpcz_store.cc:269] 0201 08:59:43.105877 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:43.114886 (+ 9009us) service_pool.cc:225] Handling call
0201 08:59:44.865370 (+1750484us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540036e054. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:44.865489 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2470450048}
I20260201 08:59:44.945341 18094 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.850126 18260 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:44.970628 18094 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:44.972018 18260 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.972628 18094 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:44.935500 17841 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:44.935580 18163 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.935765 18234 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:44.944911 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 494149us
I20260201 08:59:44.936406 17280 raft_consensus.cc:2393] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:44.934026 18114 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:44.935658 18242 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:44.994642 17207 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
W20260201 08:59:44.992594 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 59418.7us
I20260201 08:59:44.938184 18173 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.999429 18103 raft_consensus.cc:697] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:45.003715 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:44.985594 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.009666 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:45.063822 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 56316.7us
I20260201 08:59:45.070644 17204 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:45.072163 17793 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:44.996295 18114 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:44.984097 18163 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:44.984313 18246 consensus_queue.cc:1048] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260201 08:59:45.080040 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:44.990881 18224 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:44.997869 18270 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:45.040555 18117 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:44.951216 18227 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.000823 18268 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.078213 18242 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.041251 18271 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.040695 18193 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.129477 18193 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.131477 18193 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.131835 18227 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.128408 18271 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.134792 18271 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.136410 18138 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.136714 18168 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.136981 18138 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.138496 18168 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.139094 18138 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:45.116711 18154 consensus_meta.cc:287] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.591s user 0.005s sys 0.004s
I20260201 08:59:45.140067 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.140272 18118 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.141462 17210 raft_consensus.cc:2368] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.142315 18118 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:45.140393 18168 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.136487 18176 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:45.144308 18151 consensus_meta.cc:287] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.512s user 0.009s sys 0.000s
I20260201 08:59:45.144232 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.144764 18151 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.145443 17843 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.146996 18151 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.147769 18114 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.148322 17793 leader_election.cc:400] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.148650 17793 leader_election.cc:403] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:45.140219 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.149637 17136 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:44.985349 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.095641 18224 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.096309 18270 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.100656 18117 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.165129 18224 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.166194 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.166401 18117 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.080345 18182 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:45.101701 17132 raft_consensus.cc:1275] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:44.936545 18262 consensus_queue.cc:237] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.166857 17282 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:45.102828 18131 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.167164 18182 raft_consensus.cc:697] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:45.168124 18182 consensus_queue.cc:237] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.168723 18131 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:45.087064 18109 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.097618 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.068085 18173 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:45.171149 17205 raft_consensus.cc:1240] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:45.171695 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.172330 17128 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.081702 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.106113 18265 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.170848 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.112586 18103 consensus_queue.cc:237] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.114357 17131 raft_consensus.cc:1275] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:45.173153 17844 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.119009 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:44.980739 18162 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.124692 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.126454 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.127070 18242 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.150393 17134 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.001749 18198 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:44.985237 17790 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:44.983671 18155 consensus_queue.cc:1048] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260201 08:59:45.184337 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:45.163139 18114 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.164173 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.165064 18270 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:44.982824 18260 consensus_queue.cc:1048] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260201 08:59:45.171028 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:45.176069 17209 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:45.175777 17103 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.177942 17843 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
W20260201 08:59:45.143711 18175 consensus_meta.cc:287] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.527s user 0.006s sys 0.002s
W20260201 08:59:45.180541 17176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:45.200438 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.180416 17204 raft_consensus.cc:2368] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.183099 17136 raft_consensus.cc:606] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.202442 17136 raft_consensus.cc:614] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:45.202732 17279 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:45.203389 17793 leader_election.cc:400] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.203711 17793 leader_election.cc:403] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260201 08:59:45.162390 17129 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 307) took 2056 ms (client timeout 2001 ms). Trace:
W20260201 08:59:45.205261 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 129132us
I20260201 08:59:45.166955 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.187355 17285 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:45.192473 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.198581 18167 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.190709 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:45.191339 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 206184us
I20260201 08:59:45.224191 17205 raft_consensus.cc:1275] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:45.225816 17103 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.204732 18175 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.227591 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.191222 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.186312 17134 raft_consensus.cc:2376] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2. Re-sending same reply.
I20260201 08:59:45.228580 17135 raft_consensus.cc:2393] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:45.228848 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:45.229445 17211 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:45.206537 17129 rpcz_store.cc:269] 0201 08:59:43.106176 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:43.113908 (+ 7732us) service_pool.cc:225] Handling call
0201 08:59:45.162219 (+2048311us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400588254. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:45.162329 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2694737280}
I20260201 08:59:45.231003 17137 raft_consensus.cc:2368] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3.
I20260201 08:59:45.231069 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.231837 18109 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.232343 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.192303 18267 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:45.219247 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.233376 18267 raft_consensus.cc:697] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:45.233791 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.233021 17134 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.191483 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.217139 17277 raft_consensus.cc:2393] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:45.194193 18162 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.197605 17282 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.234784 18217 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.235216 18217 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.235525 18217 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.229578 17841 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:45.208278 18263 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.237988 17279 raft_consensus.cc:1275] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:45.198937 17175 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.239584 18199 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:45.201138 17278 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:45.172384 18173 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.240798 18173 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:45.241323 18173 raft_consensus.cc:697] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:45.151846 18268 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:45.241564 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:45.242162 18173 consensus_queue.cc:237] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.242856 17137 raft_consensus.cc:1275] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:45.243150 18268 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.205125 17249 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.204107 17280 raft_consensus.cc:2393] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:45.187013 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:45.243420 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:45.244683 17131 raft_consensus.cc:2376] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2. Re-sending same reply.
I20260201 08:59:45.244242 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.228560 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.244349 17249 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:45.243909 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.246160 17281 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:45.246541 17136 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.228160 18175 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.191550 18127 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.189961 18198 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.190189 18242 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.247308 18231 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.198498 18272 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.247735 18231 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.181953 18195 consensus_queue.cc:1048] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260201 08:59:45.248486 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:45.249033 17285 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.234290 18267 consensus_queue.cc:237] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.251142 18242 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:45.242156 17134 raft_consensus.cc:606] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.252372 17134 raft_consensus.cc:614] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:45.213900 17102 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.218158 17793 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.228199 17210 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:45.220628 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:45.207219 18131 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:45.210575 17130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54340 (request call id 36) took 1744 ms (client timeout 1876 ms). Trace:
I20260201 08:59:45.212478 18114 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.246466 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.263821 17133 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:45.217442 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.264816 17284 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:45.256968 17175 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.259946 17285 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
W20260201 08:59:45.260509 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 46699.7us
I20260201 08:59:45.269551 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.270002 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.274142 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:45.274681 17135 raft_consensus.cc:3055] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:45.259840 17282 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:45.274967 17135 raft_consensus.cc:740] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:45.272130 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:45.277894 17204 raft_consensus.cc:1275] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:45.243847 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.232224 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:45.248119 18231 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.275655 17135 consensus_queue.cc:260] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.283671 17135 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:45.285343 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:45.276175 17207 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
W20260201 08:59:45.289693 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:45.272307 18198 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.272470 18163 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.272225 18114 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.273540 18167 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:45.339099 17278 raft_consensus.cc:1275] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:45.296207 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.340152 17207 raft_consensus.cc:2393] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:45.232313 18109 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.328636 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:45.329327 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 97702.6us
I20260201 08:59:45.330687 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.331508 17283 raft_consensus.cc:2393] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
W20260201 08:59:45.263260 17130 rpcz_store.cc:269] 0201 08:59:43.463752 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:43.563128 (+ 99376us) service_pool.cc:225] Handling call
0201 08:59:45.204316 (+1641188us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400678254. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:45.208419 (+ 4103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1363832576}
I20260201 08:59:45.369539 17208 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:45.277565 18260 consensus_queue.cc:1048] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260201 08:59:45.337440 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:45.378971 17131 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:45.379316 17135 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:45.380088 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.381300 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.383086 18109 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.338881 18114 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.384111 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.337647 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.337797 18123 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:45.293673 17128 raft_consensus.cc:2368] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.336515 17209 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:45.325819 17102 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.368649 17248 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.273671 17276 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:45.276232 18224 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:45.287313 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.371163 17133 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.248051 18272 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.272716 18131 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.373744 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.375474 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.414829 17207 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.293406 17137 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:45.384740 17208 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.394570 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.397099 17177 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:45.399799 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 74056.7us
I20260201 08:59:45.418226 17177 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.402278 17174 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.420725 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:45.421284 17208 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.421319 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.423273 17209 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:45.326874 18265 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:45.330464 18117 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.329398 18163 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.431164 17250 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.339094 18167 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:45.383731 18263 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.398154 18109 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.419497 17102 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.441949 17102 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.393757 18246 consensus_queue.cc:1048] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260201 08:59:45.425132 17248 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:45.405371 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.379546 17131 raft_consensus.cc:606] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:45.432915 17134 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:45.405445 18118 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260201 08:59:45.409216 18148 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.340849 18198 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.443044 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.405687 18162 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.403616 17211 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:45.418360 18224 raft_consensus.cc:697] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:45.452792 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.439955 17133 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:45.426323 18151 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:45.425872 18168 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.428738 18178 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.452051 18127 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:45.443476 18163 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.464617 18103 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:45.480651 18103 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.478379 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.462689 17248 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:45.414371 18242 consensus_queue.cc:1048] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260201 08:59:45.475375 17102 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.451913 18175 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:45.471385 18243 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:45.479239 18198 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.479737 17136 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:45.444928 18167 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:45.460017 17131 raft_consensus.cc:614] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:45.433956 18265 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.502853 17208 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:45.505439 17248 leader_election.cc:400] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3.
I20260201 08:59:45.507140 17102 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.462800 18189 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:45.441509 18117 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:45.466612 18162 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.451529 18126 consensus_queue.cc:1048] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260201 08:59:45.506350 17248 leader_election.cc:403] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:45.472234 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.513767 17248 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:45.516590 17248 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.484201 18103 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:45.471689 18168 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.505376 17848 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:45.455902 18109 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.462297 18148 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:45.471957 18178 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.503604 18099 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.502504 18234 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260201 08:59:45.484958 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:45.522215 17248 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.520918 18155 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.501883 18274 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
W20260201 08:59:45.543962 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 95890.6us
I20260201 08:59:45.519852 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.543493 18168 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.559283 17250 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:45.510296 18175 raft_consensus.cc:697] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:45.554612 17839 raft_consensus.cc:2393] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:45.510022 18189 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.509169 18243 raft_consensus.cc:697] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
W20260201 08:59:45.578966 18288 log.cc:927] Time spent T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260201 08:59:45.513062 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.517576 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.580154 17841 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:45.580523 18189 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:45.484786 18151 raft_consensus.cc:697] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:45.581559 18151 consensus_queue.cc:237] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.514976 18227 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:45.584980 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.585230 18227 raft_consensus.cc:697] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:45.586213 18227 consensus_queue.cc:237] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.587705 18117 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.541363 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.550379 18132 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.589771 18132 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:45.591531 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 172502us
I20260201 08:59:45.543591 17847 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.593851 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.594457 17840 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:45.595595 18234 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:45.596055 18234 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.556035 18154 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.597083 18154 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.597421 18154 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.557657 18231 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.599174 18231 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:45.560941 18198 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:45.599887 18198 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.597385 17175 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.557000 17101 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:45.540966 18193 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:45.604377 18193 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.605013 17842 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.545158 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.549342 18094 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.546586 18269 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:45.497361 18127 raft_consensus.cc:697] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:45.551411 18178 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.569720 17848 raft_consensus.cc:1240] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:45.505597 18224 consensus_queue.cc:237] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.554075 18267 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
W20260201 08:59:45.575886 18281 log.cc:927] Time spent T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
I20260201 08:59:45.578405 18243 consensus_queue.cc:237] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.515039 18162 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:45.584757 18278 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Append to log took a long time: real 0.121s user 0.000s sys 0.000s
I20260201 08:59:45.589277 18148 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.602267 17174 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.596645 18217 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.578289 17208 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d"
dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:45104
I20260201 08:59:45.674393 17208 raft_consensus.cc:606] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.609475 17847 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:45.570199 18274 raft_consensus.cc:697] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
W20260201 08:59:45.642465 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 88833.4us
I20260201 08:59:45.604743 18193 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:45.570299 18242 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.652820 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.647828 18270 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.670262 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.606508 18182 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 08:59:45.671526 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 69336.3us
I20260201 08:59:45.610816 18138 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260201 08:59:45.603464 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 46543.8us
I20260201 08:59:45.605923 18131 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.621155 18272 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.681867 17846 raft_consensus.cc:2393] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:45.683105 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:45.681005 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 118107us
I20260201 08:59:45.648263 18173 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.591583 18132 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.620963 18114 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.605471 18160 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:45.702807 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.687318 18151 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.694005 18198 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.714331 18151 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.714003 18274 consensus_queue.cc:237] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.714722 18151 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.697799 18123 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.715405 17790 leader_election.cc:400] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.687944 18242 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.685879 18269 raft_consensus.cc:697] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:45.641850 18094 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.709755 17129 raft_consensus.cc:1240] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:45.710669 18217 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.655205 18267 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:45.707464 18289 log.cc:927] Time spent T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
I20260201 08:59:45.726949 18094 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.728964 18267 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.712361 18270 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.714198 17202 raft_consensus.cc:2368] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4.
I20260201 08:59:45.697535 18175 consensus_queue.cc:237] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.689390 18138 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:45.719162 17136 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:45.729838 17848 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:45.753772 17136 raft_consensus.cc:606] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.754154 17136 raft_consensus.cc:614] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:45.722110 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.722945 17101 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:45.716326 18114 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.750593 17134 raft_consensus.cc:1275] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:45.712975 18127 consensus_queue.cc:237] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.755117 17208 raft_consensus.cc:2368] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.760352 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260201 08:59:45.762187 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:45.763100 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:45.720561 18242 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.689519 18182 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:45.724128 18265 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.728451 18103 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.704876 18173 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.806860 18265 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.760849 18138 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:45.807633 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:45.715513 18123 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.790901 18109 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.793222 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.815073 18114 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:45.817622 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.827365 17134 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:45.819280 17136 raft_consensus.cc:1275] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:45.801621 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.793810 18272 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:45.814095 17843 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:45.808403 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.824898 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.807447 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:45.836017 18114 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:45.843557 17280 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:45.847131 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.826032 17276 raft_consensus.cc:1240] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:45.855978 17284 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:45.854532 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:45.856904 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 150022us
W20260201 08:59:45.853063 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 164509us
I20260201 08:59:45.836375 18109 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:45.849145 18299 log.cc:927] Time spent T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.150s user 0.000s sys 0.001s
I20260201 08:59:45.809777 18265 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.822053 17793 leader_election.cc:400] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.865939 17793 leader_election.cc:403] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:45.880659 17103 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.881497 18313 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
W20260201 08:59:45.885521 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 63627.2us
I20260201 08:59:45.886292 18303 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:45.886526 18270 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260201 08:59:45.888993 18303 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.890522 18270 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:45.890901 18270 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:45.891211 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.891860 17208 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:45.863801 18272 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:45.854635 17790 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:45.882232 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:45.908001 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.911295 17209 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:45.912993 17103 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.836737 18269 consensus_queue.cc:237] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.914888 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:45.864648 18109 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.917627 17134 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 4
I20260201 08:59:45.897454 18308 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:45.905567 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:45.928774 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.898029 18303 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:45.913863 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.944355 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:45.945277 17208 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:45.922610 18294 log.cc:927] Time spent T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.206s user 0.001s sys 0.001s
I20260201 08:59:45.918430 18103 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.918812 17844 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:45.906031 18272 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:45.948163 17250 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:45.929958 18125 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260201 08:59:45.922850 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 78331.3us
I20260201 08:59:45.923918 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:45.968405 17250 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:45.970791 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.977690 17207 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:45.979130 17793 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:45.986610 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:45.986937 17177 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:45.989737 17210 raft_consensus.cc:2393] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:45.952703 18313 raft_consensus.cc:697] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:45.952627 18246 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:45.955108 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:45.978224 18125 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:45.975310 18123 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:45.988427 18308 raft_consensus.cc:2804] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:45.996181 18314 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:45.950901 17839 raft_consensus.cc:1275] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:45.991412 18148 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:45.974593 18321 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:46.000403 18246 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:45.966426 18182 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:45.989020 18217 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:46.042794 17208 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
W20260201 08:59:46.035624 18311 log.cc:927] Time spent T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260201 08:59:46.031883 18308 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.045742 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:46.005501 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.038370 17277 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:45.974349 18151 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:45.985085 18319 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:46.054129 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:46.037093 18148 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.055539 17208 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:46.031512 18114 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.032655 18125 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:46.039752 18321 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.054713 18103 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:46.054600 18319 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.083582 17793 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:46.031059 18310 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260201 08:59:46.111059 18162 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.055846 18265 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.034147 18189 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.111106 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:46.103612 17134 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:46.053233 18270 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.046904 18308 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.055466 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:46.082943 18148 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
W20260201 08:59:46.133888 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 220950us
I20260201 08:59:46.095208 18272 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.123044 17203 raft_consensus.cc:2368] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:46.095901 18321 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.047017 18217 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.107429 18300 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:46.143616 17207 raft_consensus.cc:1275] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 08:59:46.144308 17842 consensus_meta.cc:287] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.503s user 0.005s sys 0.005s
I20260201 08:59:46.106637 18319 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:46.134536 18155 consensus_meta.cc:287] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.575s user 0.005s sys 0.005s
I20260201 08:59:46.113155 18309 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:46.124338 18103 raft_consensus.cc:697] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:46.139218 18109 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:46.150851 18168 consensus_meta.cc:287] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.578s user 0.007s sys 0.003s
I20260201 08:59:46.200420 17134 raft_consensus.cc:1240] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:46.104369 18313 consensus_queue.cc:237] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.145270 18270 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260201 08:59:46.149595 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:46.145118 18151 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:46.179931 18154 consensus_meta.cc:287] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.582s user 0.010s sys 0.000s
I20260201 08:59:46.223268 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.223973 17129 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:46.225106 17128 raft_consensus.cc:1275] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:46.176141 17842 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:46.223191 17839 raft_consensus.cc:2410] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260201 08:59:46.228686 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:46.229684 18163 consensus_meta.cc:287] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.749s user 0.011s sys 0.000s
I20260201 08:59:46.197523 18155 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3.
I20260201 08:59:46.232228 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.209190 17281 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:46.252032 18162 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.252785 18103 consensus_queue.cc:237] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.228586 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 549) took 1289 ms. Trace:
I20260201 08:59:46.180298 18309 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.253871 18163 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:46.254205 18167 consensus_meta.cc:287] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.738s user 0.010s sys 0.001s
I20260201 08:59:46.209806 18300 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:46.275532 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 74037.5us
I20260201 08:59:46.276150 18125 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:46.277217 18325 log.cc:927] Time spent T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
I20260201 08:59:46.218691 18168 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.226317 18154 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.282413 17206 raft_consensus.cc:2393] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:46.277592 18310 consensus_queue.cc:1048] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:46.288899 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.281648 18125 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.268385 18151 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:46.287763 17285 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:46.268244 18309 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.294924 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:46.296136 17208 raft_consensus.cc:2393] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:46.265021 17202 rpcz_store.cc:276] 0201 08:59:44.938856 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:44.940550 (+ 1694us) service_pool.cc:225] Handling call
0201 08:59:45.192367 (+251817us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f12e 000000000035a3c9 00007f74b5179560 00007f74b5241dd4 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:46.228400 (+1036033us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540017cfd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:46.228530 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1114010112}
I20260201 08:59:46.282174 18246 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.279277 18167 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.314378 18163 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:46.315038 18099 consensus_meta.cc:287] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.761s user 0.007s sys 0.003s
I20260201 08:59:46.315649 17211 raft_consensus.cc:2393] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
W20260201 08:59:46.316294 18178 consensus_meta.cc:287] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.663s user 0.009s sys 0.001s
I20260201 08:59:46.315483 18099 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 08:59:46.334674 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 195000us
W20260201 08:59:46.323976 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 287810us
I20260201 08:59:46.316216 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.350353 17284 raft_consensus.cc:1275] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:46.297835 18151 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.352824 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.361061 17133 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.355474 17128 raft_consensus.cc:1275] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:46.357321 17102 leader_election.cc:400] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4.
I20260201 08:59:46.364471 17102 leader_election.cc:403] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:46.359020 18163 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.359917 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.312726 18189 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.312508 18310 consensus_queue.cc:1059] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260201 08:59:46.359949 18309 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.315109 18321 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.363081 17845 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:46.412428 17101 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:46.388007 18329 consensus_queue.cc:1059] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260201 08:59:46.371328 17137 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:46.344619 18178 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.412899 17174 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:46.414965 18178 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.409106 17206 raft_consensus.cc:1275] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260201 08:59:46.416189 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 50915us
I20260201 08:59:46.366288 18217 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.371135 18274 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4.
W20260201 08:59:46.369782 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 48238.1us
I20260201 08:59:46.426352 17101 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:46.409200 18198 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:46.433313 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:46.441903 17207 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:46.433310 17206 raft_consensus.cc:1275] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:46.420706 17133 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:46.443342 17102 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:46.422331 18178 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:46.370528 18163 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.441474 18272 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:46.432399 17202 raft_consensus.cc:1275] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:46.461736 17174 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:46.463466 17207 raft_consensus.cc:1275] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:46.451210 18224 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:46.448961 18310 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:46.459272 18168 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.478236 18162 raft_consensus.cc:2804] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:46.459071 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.498716 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.495954 18175 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260201 08:59:46.499603 18217 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 08:59:46.500383 17177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s user 0.007s sys 0.093s
I20260201 08:59:46.462705 18154 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.449889 18198 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.502614 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:46.496498 18329 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.506541 18309 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.502934 18162 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:46.507207 17207 raft_consensus.cc:2368] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:46.507869 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.528383 17210 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.535326 17793 leader_election.cc:400] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:46.538224 18260 raft_consensus.cc:3055] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:46.535717 17793 leader_election.cc:403] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260201 08:59:46.542894 17210 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:46.499497 18331 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:46.538646 18260 raft_consensus.cc:740] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:46.544425 18321 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.559051 18319 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:46.519418 17177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s user 0.008s sys 0.094s
W20260201 08:59:46.562920 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 576013us
I20260201 08:59:46.543017 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:46.552232 17793 leader_election.cc:400] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
W20260201 08:59:46.520435 18234 consensus_meta.cc:287] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.924s user 0.010s sys 0.004s
I20260201 08:59:46.526634 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 559) took 1021 ms. Trace:
I20260201 08:59:46.547677 18329 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.556066 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.548473 18162 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:46.512698 17137 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.547111 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:46.566841 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:46.570151 18277 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:46.574347 18148 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:46.576193 18138 consensus_meta.cc:287] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.753s user 0.005s sys 0.004s
I20260201 08:59:46.555289 18330 consensus_queue.cc:1048] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260201 08:59:46.578953 17211 rpcz_store.cc:276] 0201 08:59:45.499787 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.502112 (+ 2325us) service_pool.cc:225] Handling call
0201 08:59:46.521436 (+1019324us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400570154. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:46.521585 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1692260736}
I20260201 08:59:46.512921 18168 consensus_queue.cc:1048] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260201 08:59:46.552937 18151 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.563481 18309 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.591720 17843 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:46.518563 18217 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.592290 17202 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:46.596592 18306 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.519s user 0.023s sys 0.048s
I20260201 08:59:46.560834 18246 consensus_queue.cc:1048] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260201 08:59:46.565191 18167 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.646746 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.647855 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.648388 17133 raft_consensus.cc:1240] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:46.648708 17129 raft_consensus.cc:2368] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:46.613010 18329 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.569473 18310 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.615183 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:46.581099 18300 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.589265 18263 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:46.633651 18193 consensus_meta.cc:287] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.941s user 0.009s sys 0.001s
I20260201 08:59:46.634254 18163 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.634424 18217 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:46.634690 18332 log.cc:927] Time spent T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.154s user 0.001s sys 0.000s
I20260201 08:59:46.636045 18148 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.637458 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:46.638191 18198 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.583431 18234 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.638484 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:46.608330 18138 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.659343 17843 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:46.676234 17101 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:46.706215 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:46.581240 18242 consensus_meta.cc:287] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.779s user 0.011s sys 0.000s
I20260201 08:59:46.608142 18277 raft_consensus.cc:697] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:46.678584 18329 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:46.707427 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:46.712339 18339 log.cc:927] Time spent T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.144s user 0.000s sys 0.000s
I20260201 08:59:46.713119 17209 raft_consensus.cc:2368] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:46.579941 18331 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.709532 17790 leader_election.cc:400] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:46.710568 18173 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:46.711674 17840 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.736882 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:46.737699 17841 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:46.740983 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:46.687755 18263 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.754364 18263 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:46.756961 18176 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:46.757463 18176 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.757810 18176 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.688268 18193 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.710901 18242 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:46.719741 18308 consensus_meta.cc:287] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.578s user 0.009s sys 0.002s
I20260201 08:59:46.722710 17790 leader_election.cc:403] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260201 08:59:46.750968 18310 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:46.766295 17283 raft_consensus.cc:2393] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:46.767179 18193 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.711443 18198 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:46.722229 18329 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.771210 18234 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:46.759752 18217 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.739035 18277 consensus_queue.cc:237] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.774000 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:46.714378 18319 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.803298 18246 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.778296 18138 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.779810 18118 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.807998 18246 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.720638 17202 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:46.783164 18167 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.790263 18173 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.790812 18263 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:46.817188 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 355489us
I20260201 08:59:46.823685 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.825024 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.775413 18308 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.789657 18217 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:46.807536 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 102231us
I20260201 08:59:46.820885 17793 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:46.831790 17249 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:46.835393 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.836024 17134 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:46.834129 17248 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:46.835183 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.838495 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:46.839079 17277 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:46.839500 18189 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:46.839710 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.840207 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:46.842351 18246 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:46.843725 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.844553 17102 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:46.847463 17284 raft_consensus.cc:1240] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:46.849493 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.849799 18330 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:46.850996 17843 raft_consensus.cc:2393] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 3: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:46.851166 17284 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:46.840842 17277 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.851933 17211 raft_consensus.cc:2393] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:46.839094 17841 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.828191 18175 consensus_queue.cc:1048] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260201 08:59:46.852546 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:46.852730 17203 raft_consensus.cc:1275] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:46.852591 18242 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.855330 17137 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:46.902470 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.902691 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.903329 17203 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.903419 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:46.903715 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.848037 18319 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:46.857280 17844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39002 (request call id 423) took 1682 ms. Trace:
I20260201 08:59:46.861440 18217 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:46.837399 18125 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:46.813798 18118 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.865031 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.865878 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.927165 17135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54340 (request call id 57) took 1209 ms. Trace:
I20260201 08:59:46.927539 17135 rpcz_store.cc:276] 0201 08:59:45.717845 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.718706 (+ 861us) service_pool.cc:225] Handling call
0201 08:59:46.865690 (+1146984us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:46.927098 (+ 61408us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7912704}
I20260201 08:59:46.870492 17174 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:46.876885 17206 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:46.855244 17210 raft_consensus.cc:1240] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:46.822026 18263 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.878902 17103 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:46.880283 18185 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:46.878288 18085 raft_consensus.cc:993] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:46.849417 18327 consensus_queue.cc:1048] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260201 08:59:46.878502 18246 consensus_queue.cc:1059] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260201 08:59:46.847180 18324 log.cc:927] Time spent T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.849s user 0.001s sys 0.004s
I20260201 08:59:46.882418 17840 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:46.883479 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.820031 18173 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.882579 18331 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.847687 18178 raft_consensus.cc:697] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:46.885026 18132 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.939606 18335 raft_consensus.cc:1081] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:46.939494 18132 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:46.843161 18189 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.897665 18330 raft_consensus.cc:697] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:46.940661 18189 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.898716 18329 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:46.898969 17845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38998 (request call id 337) took 1646 ms. Trace:
I20260201 08:59:46.899820 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.910687 17847 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 5
I20260201 08:59:46.901371 18308 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:46.931430 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:46.931581 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 61178.1us
W20260201 08:59:46.932801 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 54019us
I20260201 08:59:46.913770 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.928488 18125 raft_consensus.cc:697] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:46.928956 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:46.938870 18334 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:46.947643 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:46.948582 17174 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:46.951392 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:46.934593 18217 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:46.938500 18175 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:46.957202 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.909911 17844 rpcz_store.cc:276] 0201 08:59:45.174938 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.181421 (+ 6483us) service_pool.cc:225] Handling call
0201 08:59:46.856483 (+1675062us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400007dd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:46.857195 (+ 712us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":477203328}
I20260201 08:59:46.960000 17103 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:46.960835 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:46.973438 17284 raft_consensus.cc:2393] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 5: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:46.970669 17135 raft_consensus.cc:2393] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:46.972198 17102 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:46.932361 18162 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.975078 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.979727 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:46.980320 17284 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:46.981711 17847 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 08:59:46.982344 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:46.983582 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:46.984377 17249 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:46.984555 17847 raft_consensus.cc:2410] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260201 08:59:46.981278 17175 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:46.957811 18126 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:46.941269 18330 consensus_queue.cc:237] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:46.958599 18334 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:46.945803 18185 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:46.957393 17276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54632 (request call id 551) took 1052 ms. Trace:
I20260201 08:59:46.978932 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:46.998958 17276 rpcz_store.cc:276] 0201 08:59:45.898760 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.898885 (+ 125us) service_pool.cc:225] Handling call
0201 08:59:46.864839 (+965954us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:46.947284 (+ 82445us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5275392}
I20260201 08:59:47.006146 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:46.985242 18160 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:46.999253 17133 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:46.977897 18335 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:46.988248 17277 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:47.001039 18125 consensus_queue.cc:237] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.003280 18350 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:47.003142 18176 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.944305 17845 rpcz_store.cc:276] 0201 08:59:45.252491 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.263284 (+ 10793us) service_pool.cc:225] Handling call
0201 08:59:46.898779 (+1635495us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b54000046d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:46.898904 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2151566080}
I20260201 08:59:46.976643 18349 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:46.986371 18272 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:46.997696 18334 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.017596 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.971602 18175 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:46.998409 18155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s user 0.006s sys 0.014s
I20260201 08:59:47.016753 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:46.986706 18217 consensus_queue.cc:1048] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260201 08:59:47.028643 17249 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:46.993186 18348 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:46.995525 18126 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.078905 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:47.009642 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.081120 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:47.111531 17134 raft_consensus.cc:2393] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:47.110560 17206 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:47.111917 17250 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:47.165068 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 136500us
I20260201 08:59:47.025053 18132 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.031157 18350 raft_consensus.cc:697] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:47.172569 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 60674.6us
I20260201 08:59:47.027572 18272 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.081337 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:47.173990 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:46.995645 18178 consensus_queue.cc:237] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.031877 18160 consensus_queue.cc:1059] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.146s
I20260201 08:59:47.082293 18349 raft_consensus.cc:697] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:47.024675 18335 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.078140 18109 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.148s
I20260201 08:59:47.113066 18307 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:47.174240 17136 raft_consensus.cc:1240] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:47.112810 18103 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260201 08:59:47.112160 18155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s user 0.006s sys 0.024s
I20260201 08:59:47.205791 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:47.178471 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 204221us
I20260201 08:59:47.081277 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:47.080427 17132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54340 (request call id 55) took 1473 ms. Trace:
W20260201 08:59:47.180104 17848 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39018 (request call id 469) took 1477 ms (client timeout 1889 ms). Trace:
I20260201 08:59:47.081986 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:47.181147 17207 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.179476 18348 raft_consensus.cc:697] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 5 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:47.185828 18176 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.182569 18173 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.198014 18262 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.180611 18310 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.179561 18352 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:47.196471 18123 raft_consensus.cc:3055] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:47.195135 17282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 54) took 1881 ms. Trace:
I20260201 08:59:47.194754 18185 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.197539 18175 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.229169 17841 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:47.183176 18160 raft_consensus.cc:3055] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:47.183804 18349 consensus_queue.cc:237] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.191519 18335 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.175884 18167 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
W20260201 08:59:47.211144 18344 log.cc:927] Time spent T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.216s user 0.000s sys 0.001s
I20260201 08:59:47.214944 17203 raft_consensus.cc:2468] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:47.182323 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:47.181707 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.198130 18162 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.109952 18246 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:47.217206 17846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 348) took 1357 ms. Trace:
I20260201 08:59:47.171862 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.200023 18263 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.298763 18263 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:47.299780 18129 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:47.299615 18246 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.300460 17281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 61) took 1438 ms. Trace:
I20260201 08:59:47.222012 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.301291 17843 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:47.301651 18246 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.302091 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.302687 17843 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:47.222386 17284 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:47.176051 18272 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:47.193082 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:47.231527 17204 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.001067 18260 consensus_queue.cc:260] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:47.240307 17848 rpcz_store.cc:269] 0201 08:59:45.702356 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.702522 (+ 166us) service_pool.cc:225] Handling call
0201 08:59:47.179959 (+1477437us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540000b4d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:47.180052 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":49275648}
I20260201 08:59:47.249639 17103 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:47.318192 17101 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:47.275193 18262 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:46.964076 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:47.222069 18118 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.273444 16957 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51072 (request call id 138) took 4200 ms. Trace:
I20260201 08:59:47.204257 17206 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 08:59:47.208314 18307 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.275806 18123 raft_consensus.cc:740] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:47.275874 17282 rpcz_store.cc:276] 0201 08:59:45.305988 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.306142 (+ 154us) service_pool.cc:225] Handling call
0201 08:59:45.338157 (+ 32015us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:45.338441 (+ 284us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:45.338467 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:45.386858 (+ 48391us) log.cc:844] Serialized 26 byte log entry
0201 08:59:45.550533 (+163675us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:45.550572 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:45.550637 (+ 65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:45.887894 (+337257us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4800119358. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5153e21 00007f74b514aeb7 00007f74b514ad4a 00007f74b5241f7f 00007f74b5241c47 00007f74b525626c 00007f74b5256218 00007f74b5256198 00007f74b5256153 00007f74b52553fc 00007f74b41905b6
0201 08:59:47.110506 (+1222612us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b240042ced8. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74acfe0ad4 00007f74acfdebdb 00007f74ad06dad9 00007f74ad06d765 00007f74ad06ccc0 00007f74afe01828 00007f74afe01f88 00007f74afdd9738 00007f74afdd4b0a 00007f74afdd3f56
0201 08:59:47.186990 (+ 76484us) raft_consensus.cc:1685] finished
0201 08:59:47.187011 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.187138 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":28969,"raft.run_cpu_time_us":4191,"raft.run_wall_time_us":524305,"spinlock_wait_cycles":38334464,"thread_start_us":125829,"threads_started":1,"wal-append.queue_time_us":288185}
I20260201 08:59:47.272374 17130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 543) took 1361 ms. Trace:
I20260201 08:59:47.290223 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.294502 17175 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:47.310926 18126 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.297446 17793 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:47.298170 17845 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:47.294396 17205 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:47.300275 18129 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:47.081786 18329 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:47.321902 18352 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:47.320834 18176 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:47.302868 17280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 62) took 1439 ms. Trace:
I20260201 08:59:47.298640 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:47.329414 18246 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:47.312541 17279 raft_consensus.cc:1275] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260201 08:59:47.310182 17209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45106 (request call id 52) took 1392 ms (client timeout 1761 ms). Trace:
I20260201 08:59:47.298193 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.401494 17841 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:47.314019 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.310559 18351 raft_consensus.cc:2764] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260201 08:59:47.310030 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:47.310860 17285 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54632 (request call id 549) took 1519 ms (client timeout 1729 ms). Trace:
I20260201 08:59:47.186318 18350 consensus_queue.cc:237] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.276842 18310 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:47.317268 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 124390us
I20260201 08:59:47.317956 17843 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 08:59:47.319211 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 69674.9us
W20260201 08:59:47.228645 18309 consensus_meta.cc:287] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.577s user 0.010s sys 0.002s
I20260201 08:59:47.292006 18167 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.320173 17207 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:47.329934 17848 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:47.333103 17101 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:47.431023 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 98016.7us
I20260201 08:59:47.294492 17846 rpcz_store.cc:276] 0201 08:59:45.859902 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.896989 (+ 37087us) service_pool.cc:225] Handling call
0201 08:59:47.186306 (+1289317us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:47.186518 (+ 212us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.186703 (+ 185us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.186729 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.186773 (+ 44us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:47.199742 (+ 12969us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.216992 (+ 17250us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.217122 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11877632}
I20260201 08:59:47.299067 18185 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:47.285526 18160 raft_consensus.cc:740] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:47.322022 16957 rpcz_store.cc:276] 0201 08:59:43.053883 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:43.054019 (+ 136us) service_pool.cc:225] Handling call
0201 08:59:44.022137 (+968118us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b540008f554. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a40c0 00007f74b0242bba 00007f74b5fc3eac 00007f74b60be10e 00007f74b45b94a4 00007f74b45b9432 00007f74b45b9361 00007f74b45b92dc 00007f74b45b8592 00007f74ae57934c 00007f74ae578786
0201 08:59:47.254466 (+3232329us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 08:59:44.624722 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 08:59:44.785092 (+160370us) write_op.cc:432] Acquiring schema lock in shared mode
0201 08:59:44.785131 (+ 39us) write_op.cc:435] Acquired schema lock
0201 08:59:44.785145 (+ 14us) tablet.cc:660] Decoding operations
0201 08:59:44.828792 (+ 43647us) write_op.cc:620] Acquiring the partition lock for write op
0201 08:59:44.831236 (+ 2444us) write_op.cc:641] Partition lock acquired for write op
0201 08:59:44.835597 (+ 4361us) tablet.cc:683] Acquiring locks for 1 operations
0201 08:59:44.849721 (+ 14124us) tablet.cc:699] Row locks acquired
0201 08:59:44.849741 (+ 20us) write_op.cc:260] PREPARE: finished
0201 08:59:44.899373 (+ 49632us) write_op.cc:270] Start()
0201 08:59:44.904768 (+ 5395us) write_op.cc:276] Timestamp: P: 1769936384896804 usec, L: 0
0201 08:59:44.904791 (+ 23us) op_driver.cc:348] REPLICATION: starting
0201 08:59:45.000177 (+ 95386us) log.cc:844] Serialized 540 byte log entry
0201 08:59:45.886621 (+886444us) op_driver.cc:464] REPLICATION: finished
0201 08:59:46.114230 (+227609us) write_op.cc:301] APPLY: starting
0201 08:59:46.123026 (+ 8796us) tablet.cc:1365] starting BulkCheckPresence
0201 08:59:46.123158 (+ 132us) tablet.cc:1368] finished BulkCheckPresence
0201 08:59:46.137669 (+ 14511us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 08:59:46.208291 (+ 70622us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 08:59:46.208462 (+ 171us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0201 08:59:46.208507 (+ 45us) write_op.cc:312] APPLY: finished
0201 08:59:46.208724 (+ 217us) log.cc:844] Serialized 22 byte log entry
0201 08:59:46.208929 (+ 205us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:46.209014 (+ 85us) write_op.cc:454] Released schema lock
0201 08:59:46.212994 (+ 3980us) write_op.cc:341] FINISH: Updating metrics
0201 08:59:46.251428 (+ 38434us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:46.251459 (+ 31us) write_op.cc:454] Released schema lock
0201 08:59:46.639283 (+387824us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:46.639318 (+ 35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":326403,"reported_tablets":1,"spinlock_wait_cycles":227456768,"child_traces":[["op",{"apply.queue_time_us":164568,"apply.run_cpu_time_us":2829,"apply.run_wall_time_us":127411,"num_ops":1,"prepare.queue_time_us":226045,"prepare.run_cpu_time_us":60586,"prepare.run_wall_time_us":727721,"raft.queue_time_us":348839,"raft.run_cpu_time_us":117837,"raft.run_wall_time_us":756371,"replication_time_us":953464,"thread_start_us":434501,"threads_started":4,"wal-append.queue_time_us":408288,"wal-append.run_cpu_time_us":40365,"wal-append.run_wall_time_us":1874398}]]}
I20260201 08:59:47.375628 17280 rpcz_store.cc:276] 0201 08:59:45.863615 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.295700 (+1432085us) service_pool.cc:225] Handling call
0201 08:59:47.302362 (+ 6662us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.302539 (+ 177us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.302571 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.302615 (+ 44us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:47.302651 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.302712 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.302815 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260201 08:59:47.347396 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 50042.6us
I20260201 08:59:47.293756 18189 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:47.178013 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 197447us
I20260201 08:59:47.370370 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.320550 18162 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:47.329335 18132 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:47.274044 18360 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260201 08:59:47.373325 17204 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:47.375603 17131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 356) took 1512 ms. Trace:
W20260201 08:59:47.377863 17209 rpcz_store.cc:269] 0201 08:59:45.917391 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.917530 (+ 139us) service_pool.cc:225] Handling call
0201 08:59:47.310011 (+1392481us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54004e6954. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:47.310131 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1801772928}
I20260201 08:59:47.316443 18263 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.430387 18123 consensus_queue.cc:260] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:47.344714 18118 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:47.406230 17284 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:47.501086 18123 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.501761 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.501173 18118 raft_consensus.cc:697] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:47.411821 17103 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:47.426307 17177 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:47.406417 17285 rpcz_store.cc:269] 0201 08:59:45.791213 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.791371 (+ 158us) service_pool.cc:225] Handling call
0201 08:59:47.310702 (+1519331us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540054d3d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:47.310802 (+ 100us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1024319872}
I20260201 08:59:47.503762 18118 consensus_queue.cc:237] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.503963 18368 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260201 08:59:47.504674 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.505265 17285 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:47.506127 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.507174 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.501147 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:47.508071 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:47.508703 17285 raft_consensus.cc:2368] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:47.401005 18335 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:47.345198 17278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54632 (request call id 552) took 1445 ms (client timeout 1788 ms). Trace:
I20260201 08:59:47.315405 18348 consensus_queue.cc:237] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.534067 17847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 437) took 1123 ms. Trace:
I20260201 08:59:47.444132 17175 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:47.407362 18173 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.405109 18315 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.406925 18085 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:47.531236 17278 rpcz_store.cc:269] 0201 08:59:45.899471 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.899598 (+ 127us) service_pool.cc:225] Handling call
0201 08:59:47.290081 (+1390483us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:47.345130 (+ 55049us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3827456}
I20260201 08:59:47.433663 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.312549 17281 rpcz_store.cc:276] 0201 08:59:45.862532 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.863373 (+ 841us) service_pool.cc:225] Handling call
0201 08:59:45.910718 (+ 47345us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:46.255745 (+345027us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.300212 (+1044467us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54000e1854. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:47.300403 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":596685184}
I20260201 08:59:47.429975 18309 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:47.477344 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:47.482874 18270 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:47.485479 18334 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.487447 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:47.407871 18246 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.493773 18272 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:47.494396 17283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54622 (request call id 582) took 1510 ms (client timeout 1793 ms). Trace:
W20260201 08:59:47.496681 18359 log.cc:927] Time spent T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.161s user 0.001s sys 0.000s
I20260201 08:59:47.473198 17211 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:47.585565 18263 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.497403 18317 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.496891 17131 rpcz_store.cc:276] 0201 08:59:45.864483 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.882193 (+ 17710us) service_pool.cc:225] Handling call
0201 08:59:45.920082 (+ 37889us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:45.988611 (+ 68529us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:45.992632 (+ 4021us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:46.543631 (+550999us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b180023a220. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad15a2d6 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74aeb389b1 00007f74aeb47fe2 00007f74b0275851 00007f74b023a0ba
0201 08:59:46.861030 (+317399us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b2c000e5818. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74aeb389b1 00007f74aeb47fe2 00007f74b0275851 00007f74b023a0ba 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22
0201 08:59:46.861598 (+ 568us) log.cc:844] Serialized 26 byte log entry
0201 08:59:47.179874 (+318276us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:47.187877 (+ 8003us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.221996 (+ 34119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:47.341671 (+119675us) raft_consensus.cc:1685] finished
0201 08:59:47.343522 (+ 1851us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.371600 (+ 28078us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19444,"raft.queue_time_us":36026,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7414,"spinlock_wait_cycles":62886016,"thread_start_us":217444,"threads_started":1,"wal-append.queue_time_us":376194}
I20260201 08:59:47.499631 18365 raft_consensus.cc:2804] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:47.411366 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.509353 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:47.509939 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.402863 18329 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.474115 18175 consensus_queue.cc:1059] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260201 08:59:47.511276 16958 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51048 (request call id 151) took 4432 ms. Trace:
W20260201 08:59:47.514400 18367 log.cc:927] Time spent T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
I20260201 08:59:47.515273 18274 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:47.515987 18160 consensus_queue.cc:260] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.518055 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.518481 18189 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.519076 17277 raft_consensus.cc:2393] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:47.631498 17208 raft_consensus.cc:1240] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:47.519253 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:47.436987 18217 raft_consensus.cc:2764] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260201 08:59:47.505306 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:47.522583 17793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:47.437729 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:47.503851 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 92124.4us
I20260201 08:59:47.633247 17793 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:47.573140 17283 rpcz_store.cc:269] 0201 08:59:45.984052 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.050478 (+ 66426us) service_pool.cc:225] Handling call
0201 08:59:47.494131 (+1443653us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b540029aed4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:47.494319 (+ 188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1451010944}
I20260201 08:59:47.636533 17283 raft_consensus.cc:1240] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
W20260201 08:59:47.527390 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 101155us
I20260201 08:59:47.463397 17844 raft_consensus.cc:1240] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
W20260201 08:59:47.535820 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 91781.9us
W20260201 08:59:47.528494 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 159924us
I20260201 08:59:47.643950 17175 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:47.644938 17175 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:47.503888 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:47.473361 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:47.437994 18167 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:47.505980 18366 consensus_queue.cc:1175] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f97c64e8acf34ae28a520dd40fc5281c" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 08:59:47.440814 18185 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:47.534497 17847 rpcz_store.cc:276] 0201 08:59:46.410627 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.995142 (+584515us) service_pool.cc:225] Handling call
0201 08:59:47.488104 (+492962us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:47.488339 (+ 235us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.501716 (+ 13377us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.501746 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.501787 (+ 41us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:47.501815 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.533807 (+ 31992us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540000aad4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:47.533876 (+ 69us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.534009 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51368960}
I20260201 08:59:47.554674 17250 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:47.639253 18370 log.cc:927] Time spent T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.053s user 0.000s sys 0.001s
I20260201 08:59:47.530470 18314 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:47.241060 17132 rpcz_store.cc:276] 0201 08:59:45.556649 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:45.560506 (+ 3857us) service_pool.cc:225] Handling call
0201 08:59:45.592796 (+ 32290us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:45.604486 (+ 11690us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:45.604520 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:45.605039 (+ 519us) log.cc:844] Serialized 26 byte log entry
0201 08:59:45.993763 (+388724us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:45.993828 (+ 65us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:45.993903 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:46.840746 (+846843us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 08:59:46.994972 (+154226us) raft_consensus.cc:1685] finished
0201 08:59:46.994994 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.026305 (+ 31311us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1130,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":34172,"spinlock_wait_cycles":6524160,"thread_start_us":388304,"threads_started":1,"wal-append.queue_time_us":388687}
I20260201 08:59:47.533512 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.539362 18337 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:47.578208 17210 raft_consensus.cc:2393] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:47.578059 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.579049 18334 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.580494 18246 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.569957 18186 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:47.576707 18356 log.cc:927] Time spent T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.379s user 0.004s sys 0.000s
I20260201 08:59:47.581662 18262 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:47.583299 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:47.549644 18085 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.550344 18271 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.588939 18307 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.588682 17841 raft_consensus.cc:2393] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:47.584659 18310 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.591192 17209 raft_consensus.cc:2368] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3.
I20260201 08:59:47.538748 18335 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.594648 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:47.574558 18309 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.569692 17839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 354) took 1220 ms. Trace:
I20260201 08:59:47.588558 18317 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.337033 17130 rpcz_store.cc:276] 0201 08:59:45.910685 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.134394 (+223709us) service_pool.cc:225] Handling call
0201 08:59:46.854208 (+719814us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:46.854422 (+ 214us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:46.880149 (+ 25727us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:46.880191 (+ 42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:46.880726 (+ 535us) log.cc:844] Serialized 26 byte log entry
0201 08:59:47.111880 (+231154us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:47.173672 (+ 61792us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.177781 (+ 4109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:47.226997 (+ 49216us) raft_consensus.cc:1685] finished
0201 08:59:47.227021 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.269430 (+ 42409us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13623,"raft.queue_time_us":24568,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":13114,"spinlock_wait_cycles":5801344,"thread_start_us":171032,"threads_started":1,"wal-append.queue_time_us":317663}
I20260201 08:59:47.544739 18173 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.568001 18270 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.549827 18315 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.502928 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.689527 18186 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.601380 16958 rpcz_store.cc:276] 0201 08:59:43.078545 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:43.078719 (+ 174us) service_pool.cc:225] Handling call
0201 08:59:43.634481 (+555762us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540008f554. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a40c0 00007f74b0242bba 00007f74b5fc3eac 00007f74b60be10e 00007f74b45b94a4 00007f74b45b9432 00007f74b45b9361 00007f74b45b92dc 00007f74b45b8592 00007f74ae57934c 00007f74ae578786
0201 08:59:47.511206 (+3876725us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 08:59:45.377232 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 08:59:45.377735 (+ 503us) write_op.cc:432] Acquiring schema lock in shared mode
0201 08:59:45.377763 (+ 28us) write_op.cc:435] Acquired schema lock
0201 08:59:45.377775 (+ 12us) tablet.cc:660] Decoding operations
0201 08:59:45.378087 (+ 312us) write_op.cc:620] Acquiring the partition lock for write op
0201 08:59:45.378135 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0201 08:59:45.378160 (+ 25us) tablet.cc:683] Acquiring locks for 1 operations
0201 08:59:45.378324 (+ 164us) tablet.cc:699] Row locks acquired
0201 08:59:45.378337 (+ 13us) write_op.cc:260] PREPARE: finished
0201 08:59:45.378466 (+ 129us) write_op.cc:270] Start()
0201 08:59:45.378587 (+ 121us) write_op.cc:276] Timestamp: P: 1769936385378423 usec, L: 0
0201 08:59:45.378603 (+ 16us) op_driver.cc:348] REPLICATION: starting
0201 08:59:45.379164 (+ 561us) log.cc:844] Serialized 540 byte log entry
0201 08:59:46.041773 (+662609us) op_driver.cc:464] REPLICATION: finished
0201 08:59:46.251815 (+210042us) write_op.cc:301] APPLY: starting
0201 08:59:46.251893 (+ 78us) tablet.cc:1365] starting BulkCheckPresence
0201 08:59:46.251982 (+ 89us) tablet.cc:1368] finished BulkCheckPresence
0201 08:59:46.252091 (+ 109us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 08:59:46.252338 (+ 247us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 08:59:46.252478 (+ 140us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0201 08:59:46.252521 (+ 43us) write_op.cc:312] APPLY: finished
0201 08:59:46.252717 (+ 196us) log.cc:844] Serialized 22 byte log entry
0201 08:59:46.252932 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:46.253013 (+ 81us) write_op.cc:454] Released schema lock
0201 08:59:46.253059 (+ 46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1691611,"reported_tablets":1,"spinlock_wait_cycles":263771008,"child_traces":[["op",{"apply.queue_time_us":207164,"apply.run_cpu_time_us":1528,"apply.run_wall_time_us":1530,"num_ops":1,"prepare.queue_time_us":963308,"prepare.run_cpu_time_us":2175,"prepare.run_wall_time_us":2174,"replication_time_us":655919,"thread_start_us":588025,"threads_started":1}]]}
I20260201 08:59:47.646049 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.714365 17843 raft_consensus.cc:2393] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:47.595294 18365 raft_consensus.cc:697] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:47.647387 17248 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:47.648073 17794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:47.650498 17175 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:47.729833 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 79402.8us
I20260201 08:59:47.650676 18151 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:47.650496 18350 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:47.651831 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.654043 18329 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:47.744676 18350 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.631160 18274 raft_consensus.cc:697] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:47.745180 18350 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.746016 18274 consensus_queue.cc:237] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.657393 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:47.626993 18198 raft_consensus.cc:3055] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
W20260201 08:59:47.665678 17103 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.194.68:45925 timed out after 1.729s (SENT) [suppressed 2 similar messages]
I20260201 08:59:47.554529 17278 raft_consensus.cc:1275] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260201 08:59:47.668027 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 113445us
I20260201 08:59:47.750175 18268 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:47.628638 18129 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:47.670464 18243 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:47.749583 18198 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:47.750947 18243 raft_consensus.cc:697] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:47.745110 18349 raft_consensus.cc:2804] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:47.751346 18198 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.725564 18271 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.751855 18243 consensus_queue.cc:237] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.752177 18350 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.753741 18271 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.672632 18167 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:47.754156 18350 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.750429 17250 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:47.755334 18348 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:47.755968 18348 raft_consensus.cc:697] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:47.650501 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:47.661000 18162 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260201 08:59:47.759080 17136 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:47.786165 17136 raft_consensus.cc:606] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
W20260201 08:59:47.681600 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 48451.7us
I20260201 08:59:47.788581 17793 leader_election.cc:400] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:47.788923 17793 leader_election.cc:403] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:47.786705 17136 raft_consensus.cc:614] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:47.661145 18327 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260201 08:59:47.690117 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.799201 17794 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:47.694370 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:47.715152 17102 leader_election.cc:400] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3.
I20260201 08:59:47.800124 17102 leader_election.cc:403] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260201 08:59:47.703754 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.683722 18337 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:47.728178 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 80869.7us
I20260201 08:59:47.696779 17280 raft_consensus.cc:1240] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
W20260201 08:59:47.687533 18277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s user 0.002s sys 0.006s
I20260201 08:59:47.698225 18085 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.738734 18335 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.702697 18360 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:47.757269 18349 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.743178 17841 raft_consensus.cc:1275] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:47.708890 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:47.693009 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 62997.4us
I20260201 08:59:47.697467 18185 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:47.744539 18151 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.655978 17844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39018 (request call id 479) took 1210 ms. Trace:
I20260201 08:59:47.752530 18198 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.675835 18272 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.810658 18366 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.669028 18175 consensus_queue.cc:1059] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260201 08:59:47.757678 17250 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:47.800835 17794 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:47.860245 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 102636us
I20260201 08:59:47.728526 17848 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39002
I20260201 08:59:47.700369 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:47.837178 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:47.810227 18167 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:47.699564 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:47.725378 18309 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:47.815603 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 100598us
I20260201 08:59:47.757164 17131 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.757650 18377 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:47.756757 18348 consensus_queue.cc:237] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.865494 18366 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:47.814834 18277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s user 0.003s sys 0.006s
W20260201 08:59:47.846412 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 180753us
I20260201 08:59:47.810645 18337 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.807469 18246 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:47.813318 17203 raft_consensus.cc:1240] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:47.847162 18360 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:47.682946 18314 raft_consensus.cc:697] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:47.860311 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 59538.6us
I20260201 08:59:47.692257 18279 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:47.861107 17848 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:47.861457 17250 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:47.916988 17794 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:47.918963 17794 leader_election.cc:400] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3.
I20260201 08:59:47.916057 17848 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:47.920950 17103 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:47.715142 17839 rpcz_store.cc:276] 0201 08:59:46.349430 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.351085 (+ 1655us) service_pool.cc:225] Handling call
0201 08:59:47.457667 (+1106582us) spinlock_profiling.cc:243] Waited 8.78 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f12e 000000000035a3c9 00007f74b5179560 00007f74b5241dd4 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:47.480597 (+ 22930us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.530010 (+ 49413us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.533220 (+ 3210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.537863 (+ 4643us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:47.543281 (+ 5418us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.561594 (+ 18313us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.569617 (+ 8023us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20188928}
W20260201 08:59:47.926457 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 65079.8us
I20260201 08:59:47.894418 18315 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.935168 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:47.936443 17280 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.937362 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.938800 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:47.939703 17281 raft_consensus.cc:1275] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260201 08:59:47.940174 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:47.932916 18300 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:47.943271 18300 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:47.945628 18300 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:47.947772 17280 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:47.863449 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.839509 18363 raft_consensus.cc:3060] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.807122 17248 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:47.953605 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 146560us
I20260201 08:59:47.954463 17248 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:47.955230 18243 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:47.955897 18243 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:47.839833 18321 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:47.956614 18321 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:47.958812 18321 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.844847 18349 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:47.797284 18268 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:47.849496 18382 log.cc:927] Time spent T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.124s user 0.000s sys 0.000s
I20260201 08:59:47.870210 18182 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:47.966045 18182 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:47.966507 18182 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:47.879128 18309 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.754660 18365 consensus_queue.cc:237] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:47.864162 18185 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:47.881636 18186 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:47.873430 18271 raft_consensus.cc:3055] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:47.973755 18271 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:47.974714 18271 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:47.853092 18151 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:47.883563 18173 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.980002 17248 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:47.983777 18151 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:47.986461 18151 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:47.989818 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:48.001049 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 81202.7us
W20260201 08:59:47.893385 18383 log.cc:927] Time spent T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.112s user 0.000s sys 0.001s
I20260201 08:59:47.884039 17137 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:47.882342 18317 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:47.897081 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:47.899370 18260 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:48.042093 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:47.895272 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:47.895721 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:47.905766 17846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 358) took 1063 ms. Trace:
I20260201 08:59:47.931041 18351 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:48.095146 17133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46082 (request call id 553) took 1257 ms. Trace:
I20260201 08:59:48.130676 17133 rpcz_store.cc:276] 0201 08:59:46.837924 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.839450 (+ 1526us) service_pool.cc:225] Handling call
0201 08:59:48.094913 (+1255463us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54005dded4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:48.095071 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":365490048}
I20260201 08:59:48.015024 17129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54340 (request call id 71) took 1362 ms. Trace:
I20260201 08:59:48.132056 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.153523 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.130086 18317 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:48.069852 18162 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:48.154603 18317 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:48.155460 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:48.009755 18272 consensus_queue.cc:1048] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.191s
I20260201 08:59:48.156800 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:48.145368 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:48.160835 17839 raft_consensus.cc:1275] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:48.161360 18162 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:48.163439 18162 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:47.892458 17790 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:48.164109 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 164009us
W20260201 08:59:48.164456 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 272076us
I20260201 08:59:47.895881 18377 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.190s
I20260201 08:59:48.173254 18309 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:48.173692 17131 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:48.175064 18317 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:48.150365 18360 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:48.150825 18366 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:47.851977 17844 rpcz_store.cc:276] 0201 08:59:46.445818 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.182200 (+736382us) service_pool.cc:225] Handling call
0201 08:59:47.182490 (+ 290us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.654469 (+471979us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.655692 (+ 1223us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54006892d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:47.655911 (+ 219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":584606592}
I20260201 08:59:48.129745 17846 rpcz_store.cc:276] 0201 08:59:46.842026 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.513295 (+671269us) service_pool.cc:225] Handling call
0201 08:59:47.513586 (+ 291us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.684318 (+170732us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.686824 (+ 2506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.689520 (+ 2696us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:47.689558 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.905522 (+215964us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400004bd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:47.905571 (+ 49us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:47.905706 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":375987968}
I20260201 08:59:48.152540 17129 rpcz_store.cc:276] 0201 08:59:46.647399 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.649440 (+ 2041us) service_pool.cc:225] Handling call
0201 08:59:46.677035 (+ 27595us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:46.704589 (+ 27554us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:46.705448 (+ 859us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:46.720059 (+ 14611us) log.cc:844] Serialized 26 byte log entry
0201 08:59:47.707281 (+987222us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b18002121a0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab 00007f74afdd90c3 00007f74afdd9471 00007f74b01f573f
0201 08:59:47.839670 (+132389us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:47.844499 (+ 4829us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:47.852186 (+ 7687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:47.889043 (+ 36857us) raft_consensus.cc:1685] finished
0201 08:59:47.889078 (+ 35us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:48.009487 (+120409us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1693,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7288,"spinlock_wait_cycles":9599360,"thread_start_us":98238,"threads_started":1,"wal-append.queue_time_us":1166634}
I20260201 08:59:48.177703 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.178994 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.179590 17129 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:48.149652 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.181082 18314 consensus_queue.cc:237] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:48.187453 18360 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:48.188030 18360 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:48.190532 18360 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:48.158150 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:48.194574 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:48.176975 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.197543 17248 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:48.217674 17793 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:47.916425 18279 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:48.235260 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 233369us
I20260201 08:59:48.071255 17137 raft_consensus.cc:606] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
W20260201 08:59:48.238366 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 426364us
I20260201 08:59:48.240078 17794 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:48.247903 17794 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:48.241190 17793 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:48.020641 18185 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:48.018224 18368 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:48.196815 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:48.201220 18360 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:48.201772 18317 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:48.272397 17285 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s user 0.204s sys 0.263s
W20260201 08:59:48.272933 17285 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s user 0.204s sys 0.263s
I20260201 08:59:48.244077 17137 raft_consensus.cc:614] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:48.209425 18162 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:48.261515 17794 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:48.270488 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.250774 18351 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:48.047878 18246 consensus_queue.cc:1059] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.220s
I20260201 08:59:48.252879 17793 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:48.270742 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:48.331060 17284 raft_consensus.cc:2376] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3. Re-sending same reply.
I20260201 08:59:48.318569 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54622 (request call id 592) took 1291 ms. Trace:
I20260201 08:59:48.254086 18309 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:48.336843 17277 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:48.338209 18186 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:48.249612 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.244776 18279 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:48.331908 17285 rpcz_store.cc:276] 0201 08:59:47.026959 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.561668 (+534709us) service_pool.cc:225] Handling call
0201 08:59:47.562016 (+ 348us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:47.562365 (+ 349us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.562395 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:47.562920 (+ 525us) log.cc:844] Serialized 26 byte log entry
0201 08:59:47.666396 (+103476us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:48.318026 (+651630us) log.cc:844] Serialized 14 byte log entry
0201 08:59:48.318284 (+ 258us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:48.318351 (+ 67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:48.318390 (+ 39us) raft_consensus.cc:1685] finished
0201 08:59:48.318399 (+ 9us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:48.318515 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":180129,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":95,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":9460,"thread_start_us":679385,"threads_started":2,"wal-append.queue_time_us":112724}
I20260201 08:59:48.334918 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:48.261204 18262 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:48.335906 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 83165us
I20260201 08:59:48.263499 18310 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:48.354720 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.355867 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.357085 18182 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:48.359035 18085 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:48.359762 17279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 63) took 1063 ms. Trace:
I20260201 08:59:48.359601 18085 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:48.240558 18349 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:48.353127 17134 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:48.361194 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.254944 18366 consensus_queue.cc:1059] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.079s
I20260201 08:59:48.351334 17848 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:48.362968 17793 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:48.369225 17177 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s user 0.007s sys 0.020s
W20260201 08:59:48.369671 17177 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.505s user 0.007s sys 0.020s
W20260201 08:59:48.369925 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 549806us
I20260201 08:59:48.592609 18349 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:48.338759 18186 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:48.376948 17283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s user 0.053s sys 0.132s
W20260201 08:59:48.748014 17283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.049s user 0.054s sys 0.141s
W20260201 08:59:48.623701 17209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s user 0.014s sys 0.063s
I20260201 08:59:48.419895 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:48.370836 18300 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260201 08:59:48.750149 18300 raft_consensus.cc:3055] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:48.750507 18300 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:48.751240 18300 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:48.751632 18186 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:48.752441 18300 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:48.435776 17248 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:48.753417 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 317719us
I20260201 08:59:48.754084 18243 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260201 08:59:48.749311 17209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s user 0.014s sys 0.067s
I20260201 08:59:48.391705 17285 raft_consensus.cc:1275] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:48.537943 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:48.757541 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.757905 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:48.758090 18240 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:48.758630 18240 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:48.759181 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:48.760365 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:48.514068 18363 consensus_meta.cc:287] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.531s user 0.005s sys 0.005s
I20260201 08:59:48.761847 18363 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3.
I20260201 08:59:48.475030 18085 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:48.538987 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:48.764535 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:48.765096 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:48.554695 18337 consensus_meta.cc:287] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.661s user 0.002s sys 0.007s
I20260201 08:59:48.493177 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:48.360173 17279 rpcz_store.cc:276] 0201 08:59:47.296614 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.634557 (+337943us) service_pool.cc:225] Handling call
0201 08:59:47.634843 (+ 286us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.684820 (+ 49977us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 08:59:47.815033 (+130213us) log.cc:844] Serialized 14 byte log entry
0201 08:59:47.948469 (+133436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.948531 (+ 62us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:47.948577 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:48.359516 (+410939us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b5400153454. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:48.359571 (+ 55us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:48.359709 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":161690,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":387,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":114387712,"thread_start_us":249081,"threads_started":2,"wal-append.queue_time_us":120508}
I20260201 08:59:48.446396 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.429461 18327 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:48.376626 17848 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:48.359105 18182 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:48.333699 18162 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:48.256055 18274 consensus_queue.cc:1059] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260201 08:59:48.347772 18365 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:48.339524 18368 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:48.319546 18317 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:48.367787 18381 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:48.310813 18360 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:48.444165 18366 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:48.457507 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:48.350220 17790 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:48.591032 18260 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:48.431013 18198 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:48.705613 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 444145us
I20260201 08:59:48.807438 17794 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:48.640471 18348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s user 0.012s sys 0.021s
W20260201 08:59:48.639076 17174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s user 0.014s sys 0.019s
I20260201 08:59:48.708570 18314 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:48.773101 17277 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:48.772574 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.802016 18274 raft_consensus.cc:3055] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
W20260201 08:59:48.809403 17174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s user 0.015s sys 0.019s
W20260201 08:59:48.817059 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 909385us
I20260201 08:59:48.769129 18337 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:48.769551 17848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39002 (request call id 445) took 1828 ms. Trace:
I20260201 08:59:48.822302 17848 rpcz_store.cc:276] 0201 08:59:46.941392 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.728408 (+787016us) service_pool.cc:225] Handling call
0201 08:59:48.769496 (+1041088us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:48.773808 17202 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:48.784245 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 75) took 1135 ms. Trace:
I20260201 08:59:48.801389 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:48.773504 18327 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:48.809132 18348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.877s user 0.012s sys 0.021s
I20260201 08:59:48.821152 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:48.799342 18400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s user 0.012s sys 0.029s
I20260201 08:59:48.823732 17848 raft_consensus.cc:1240] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:48.811419 17794 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:48.816869 18274 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:48.812383 18368 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:48.812808 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 478503us
W20260201 08:59:48.870461 17251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s user 0.035s sys 0.052s
I20260201 08:59:48.872517 17793 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:48.812382 18198 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:48.815239 18366 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:48.875875 17848 raft_consensus.cc:1275] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:48.826125 18240 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:48.816612 18314 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:48.810027 18260 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:48.890632 18366 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:48.828006 18085 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:48.873584 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 62245.9us
I20260201 08:59:48.830436 18350 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:48.890141 17839 raft_consensus.cc:1240] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
W20260201 08:59:48.882913 17251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s user 0.035s sys 0.052s
I20260201 08:59:48.932442 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:48.879282 18400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s user 0.013s sys 0.029s
I20260201 08:59:48.898134 17135 raft_consensus.cc:1240] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:48.898684 17174 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:48.894917 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 138456us
I20260201 08:59:48.879633 18394 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:48.881852 18410 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:48.948338 17134 raft_consensus.cc:606] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:48.949997 17134 raft_consensus.cc:614] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:48.887708 18365 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:48.927922 18411 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:48.874366 18132 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:48.961438 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.939216 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:48.945945 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 47361.9us
I20260201 08:59:48.965029 17174 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:48.895398 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:48.922453 18366 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:48.963356 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:48.947204 18391 log.cc:927] Time spent T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260201 08:59:48.972117 17279 raft_consensus.cc:2410] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 08:59:48.959128 18365 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:48.944343 18085 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:48.967005 18410 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:48.962982 18335 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
W20260201 08:59:48.976107 18407 log.cc:927] Time spent T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.173s user 0.000s sys 0.001s
I20260201 08:59:48.948659 18349 consensus_queue.cc:1048] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260201 08:59:48.955027 18400 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:48.973870 17202 raft_consensus.cc:3055] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:48.920946 18413 consensus_queue.cc:1059] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260201 08:59:48.967909 18186 raft_consensus.cc:2764] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260201 08:59:48.954948 17846 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:48.948486 18350 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:48.988675 18162 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:48.993292 18317 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:48.992672 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:48.929457 18274 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:48.955408 18394 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:48.971006 18132 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:48.968242 18411 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.037734 18360 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.038745 18243 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.032817 18365 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.040441 18418 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:49.042578 17202 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:49.067785 18412 log.cc:927] Time spent T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.172s user 0.001s sys 0.000s
I20260201 08:59:49.044610 18400 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.055461 18426 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:49.078017 18426 raft_consensus.cc:697] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:49.078580 18416 log.cc:927] Time spent T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
I20260201 08:59:49.078948 18426 consensus_queue.cc:237] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:49.079816 18384 log.cc:927] Time spent T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 1.444s user 0.019s sys 0.007s
I20260201 08:59:49.079998 18428 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:49.064750 18327 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.080581 18428 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.081437 18260 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.081852 17841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39018 (request call id 491) took 1284 ms. Trace:
I20260201 08:59:48.827752 17283 rpcz_store.cc:276] 0201 08:59:47.648641 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.696983 (+ 48342us) service_pool.cc:225] Handling call
0201 08:59:47.697315 (+ 332us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:47.697687 (+ 372us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.697723 (+ 36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:47.698234 (+ 511us) log.cc:844] Serialized 26 byte log entry
0201 08:59:48.748455 (+1050221us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:48.748784 (+ 329us) log.cc:844] Serialized 14 byte log entry
0201 08:59:48.749025 (+ 241us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:48.749106 (+ 81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:48.767691 (+ 18585us) raft_consensus.cc:1685] finished
0201 08:59:48.768384 (+ 693us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:48.776830 (+ 8446us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1134,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2168,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":205,"thread_start_us":1049809,"threads_started":1,"wal-append.queue_time_us":1063143}
I20260201 08:59:49.039187 18335 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.082681 18428 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.083582 18400 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.084055 18335 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.084472 18314 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.086882 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.087543 17848 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:49.088423 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.071209 17132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 560) took 1195 ms. Trace:
I20260201 08:59:49.072278 18420 consensus_queue.cc:1059] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:49.052345 18337 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.061724 18425 consensus_queue.cc:1048] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260201 08:59:49.115221 18132 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.115046 17132 rpcz_store.cc:276] 0201 08:59:47.875735 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.181990 (+306255us) service_pool.cc:225] Handling call
0201 08:59:48.182311 (+ 321us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:48.182529 (+ 218us) raft_consensus.cc:1534] Early marking committed up to index 2
0201 08:59:48.824270 (+641741us) log.cc:844] Serialized 14 byte log entry
0201 08:59:49.070797 (+246527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.070883 (+ 86us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:49.070942 (+ 59us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.071019 (+ 77us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.071149 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":151999,"prepare.queue_time_us":172395,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":92710,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2344,"thread_start_us":660524,"threads_started":3,"wal-append.queue_time_us":226973}
W20260201 08:59:49.077157 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 51691.8us
I20260201 08:59:49.082270 17841 rpcz_store.cc:276] 0201 08:59:47.797971 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.147064 (+349093us) service_pool.cc:225] Handling call
0201 08:59:48.147455 (+ 391us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:48.147684 (+ 229us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:48.147711 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:48.148214 (+ 503us) log.cc:844] Serialized 26 byte log entry
0201 08:59:48.564308 (+416094us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:48.579130 (+ 14822us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:48.579208 (+ 78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:49.069065 (+489857us) raft_consensus.cc:1685] finished
0201 08:59:49.073187 (+ 4122us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.081789 (+ 8602us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":342442,"threads_started":1,"wal-append.queue_time_us":615898}
I20260201 08:59:49.077335 18198 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.063231 17839 raft_consensus.cc:1275] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:49.118510 17249 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:49.075855 18395 log.cc:927] Time spent T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.205s user 0.001s sys 0.000s
I20260201 08:59:49.120451 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:49.073974 18408 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.241s user 0.000s sys 0.001s
W20260201 08:59:49.075034 18309 consensus_meta.cc:287] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.738s user 0.010s sys 0.000s
W20260201 08:59:49.129859 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 61291.2us
I20260201 08:59:49.077600 18394 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.134655 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.135080 18300 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:49.135525 18300 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:49.133133 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.136027 18300 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.136792 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.137470 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.137969 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.138599 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.139323 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.139693 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.040940 18410 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.074676 18419 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.132081 17794 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:49.143975 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 170746us
I20260201 08:59:49.149493 17101 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:49.149766 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 205838us
I20260201 08:59:49.127254 18260 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.152688 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.153431 17281 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:49.153887 17101 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.156839 17848 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:49.141453 18309 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.075372 18243 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.159253 17101 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.142547 18368 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.155546 18198 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:49.161931 18260 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.173172 18436 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.173679 18436 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.174207 18260 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.175756 18436 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.076567 18418 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.161931 18422 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.178386 17209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 590) took 1646 ms. Trace:
I20260201 08:59:49.157718 18167 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:49.176970 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.187232 17281 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:49.188174 17794 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:49.143817 18419 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.189469 18418 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.190248 18419 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.150503 18362 consensus_queue.cc:1048] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260201 08:59:49.190930 18411 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.185513 17209 rpcz_store.cc:276] 0201 08:59:47.524774 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.714563 (+189789us) service_pool.cc:225] Handling call
0201 08:59:47.741181 (+ 26618us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:47.788705 (+ 47524us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.788741 (+ 36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:47.789265 (+ 524us) log.cc:844] Serialized 26 byte log entry
0201 08:59:48.755298 (+966033us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:48.755342 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:48.755410 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:49.170668 (+415258us) raft_consensus.cc:1685] finished
0201 08:59:49.170686 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.170796 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":47092,"raft.queue_time_us":47984,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":15241,"thread_start_us":909965,"threads_started":1,"wal-append.queue_time_us":992185}
I20260201 08:59:49.176748 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:49.199191 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 80780.1us
I20260201 08:59:49.177343 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.199810 17177 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.171591 18368 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.202641 17177 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.166738 17103 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:49.205927 17177 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.205971 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:49.188223 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.166226 18435 consensus_queue.cc:1048] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260201 08:59:49.208461 18419 consensus_queue.cc:1059] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:49.209285 18419 raft_consensus.cc:3055] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:49.209466 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.209609 18419 raft_consensus.cc:740] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:49.210498 18419 consensus_queue.cc:260] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.211457 18419 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.212566 17103 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:49.213138 18439 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:49.213373 18362 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:49.213794 18362 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:49.214138 18362 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.214818 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.215541 17281 raft_consensus.cc:2393] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:49.215448 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.152942 17202 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.219168 17793 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:49.203336 18279 consensus_meta.cc:287] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.835s user 0.007s sys 0.004s
I20260201 08:59:49.167959 18360 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:49.217567 18366 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.223454 18430 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:49.223681 18410 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.201371 18167 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:49.222635 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.231536 18167 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:49.231707 17281 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:49.231957 18167 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.223971 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.232838 17794 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:49.200734 18413 consensus_queue.cc:1048] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260201 08:59:49.234936 18368 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.235489 18368 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:49.235771 18368 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:49.235975 18368 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.223909 18279 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.226176 17177 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.227033 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:49.227416 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:49.205091 18350 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.219815 18439 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:49.228812 17202 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:49.217190 18411 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:49.228976 18432 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.219796 18132 consensus_queue.cc:1048] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260201 08:59:49.224682 17283 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:49.207341 18337 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:49.223990 18420 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.241108 18439 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:49.229792 18243 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.230840 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.233137 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.233064 17129 raft_consensus.cc:2393] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:49.204124 18394 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.206640 18085 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.257205 17101 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.257006 18431 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.238785 17177 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.238523 18413 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:49.241986 18411 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.250025 17843 raft_consensus.cc:1240] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:49.242004 18432 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.262564 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.252185 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.253208 17794 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:49.253475 17207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 586) took 1792 ms. Trace:
I20260201 08:59:49.255620 18271 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:49.264376 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 71537.2us
I20260201 08:59:49.249931 18430 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.258270 18360 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.240231 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.271806 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.272213 18432 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.272550 17841 raft_consensus.cc:2393] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:49.258641 18410 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.273363 18132 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:49.273205 18410 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.273511 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.273871 18132 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.275130 18410 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.264642 18327 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.276083 18327 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.277966 18327 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.278143 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.260097 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.279740 17101 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.261097 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.261276 18085 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.270208 18429 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:49.270126 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.258059 18431 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.280539 17209 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:49.280828 17101 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:49.275635 18132 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.282474 18422 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:49.287133 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.264048 17207 rpcz_store.cc:276] 0201 08:59:47.461142 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.652607 (+191465us) service_pool.cc:225] Handling call
0201 08:59:49.137288 (+1484681us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:49.137480 (+ 192us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:49.137816 (+ 336us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.137844 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:49.138274 (+ 430us) log.cc:844] Serialized 26 byte log entry
0201 08:59:49.163507 (+ 25233us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:49.163549 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.163613 (+ 64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:49.253230 (+ 89617us) raft_consensus.cc:1685] finished
0201 08:59:49.253249 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.253421 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2463,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":25357184,"thread_start_us":24844,"threads_started":1,"wal-append.queue_time_us":86663}
I20260201 08:59:49.288085 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.288478 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.283288 18365 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.284183 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 587) took 1822 ms. Trace:
I20260201 08:59:49.266960 17202 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:49.288993 17209 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:49.288923 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.287220 18422 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.290078 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.290119 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.290378 17793 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:49.289179 17211 rpcz_store.cc:276] 0201 08:59:47.461529 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.660112 (+198583us) service_pool.cc:225] Handling call
0201 08:59:47.660519 (+ 407us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:47.860255 (+199736us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.864683 (+ 4428us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:47.883196 (+ 18513us) log.cc:844] Serialized 26 byte log entry
0201 08:59:48.251209 (+368013us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:48.255399 (+ 4190us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.283808 (+1028409us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540017ded4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:49.283865 (+ 57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:49.283912 (+ 47us) raft_consensus.cc:1685] finished
0201 08:59:49.283926 (+ 14us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.284122 (+ 196us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12453,"raft.queue_time_us":4390,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":6915,"spinlock_wait_cycles":336110976,"thread_start_us":325850,"threads_started":1,"wal-append.queue_time_us":536632}
I20260201 08:59:49.291261 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.291507 17844 raft_consensus.cc:2393] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:49.291824 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.292142 17209 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:49.292461 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.292327 18365 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.293416 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.294440 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 592) took 1761 ms. Trace:
I20260201 08:59:49.294250 17209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 591) took 1764 ms. Trace:
W20260201 08:59:49.285656 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:49.295338 18433 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.294842 17211 rpcz_store.cc:276] 0201 08:59:47.532905 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.293506 (+1760601us) service_pool.cc:225] Handling call
0201 08:59:49.293806 (+ 300us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.293988 (+ 182us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.294014 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.294054 (+ 40us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:49.294221 (+ 167us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.294285 (+ 64us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.294389 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.267220 18413 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.295053 17209 rpcz_store.cc:276] 0201 08:59:47.529742 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.293153 (+1763411us) service_pool.cc:225] Handling call
0201 08:59:49.293414 (+ 261us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.293577 (+ 163us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.293600 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.293640 (+ 40us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:49.293668 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.293716 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.293804 (+ 88us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.296123 17207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 593) took 1758 ms. Trace:
I20260201 08:59:49.297794 17207 rpcz_store.cc:276] 0201 08:59:47.537474 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.294308 (+1756834us) service_pool.cc:225] Handling call
0201 08:59:49.294601 (+ 293us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.294761 (+ 160us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.294782 (+ 21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.294819 (+ 37us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:49.294874 (+ 55us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.294928 (+ 54us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.296069 (+ 1141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.298661 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.299563 17279 raft_consensus.cc:1275] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:49.282370 18155 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.279431 18430 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.300477 18155 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.301338 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.302091 17277 raft_consensus.cc:2393] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:49.302454 18155 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.303021 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.295708 18429 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:49.303828 18429 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.304553 17209 raft_consensus.cc:1275] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:49.320221 17277 raft_consensus.cc:1275] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:49.321309 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.319943 17278 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:49.300482 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.319931 17209 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 594) took 1779 ms. Trace:
I20260201 08:59:49.296905 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:49.293198 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.326274 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.325663 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.257773 18362 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.327579 17278 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:49.301968 18430 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.331764 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.329767 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.332890 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.333426 18362 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.334069 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:49.334645 17211 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.331820 17133 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:49.325939 18182 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.337949 17202 raft_consensus.cc:2410] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260201 08:59:49.337738 18182 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.338855 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.339699 18182 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.319849 18271 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.336620 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.303290 18411 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.319597 18366 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.341316 17793 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.325407 17209 rpcz_store.cc:276] 0201 08:59:47.540947 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.297647 (+1756700us) service_pool.cc:225] Handling call
0201 08:59:49.297884 (+ 237us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.319642 (+ 21758us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.319876 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.342988 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.343595 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:49.337283 18378 log.cc:927] Time spent T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 1.698s user 0.014s sys 0.024s
I20260201 08:59:49.344255 17209 raft_consensus.cc:2393] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:49.303323 17129 raft_consensus.cc:1275] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:49.327538 18381 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:49.349682 18381 raft_consensus.cc:697] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
W20260201 08:59:49.349967 17842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39018 (request call id 480) took 2903 ms (client timeout 1632 ms). Trace:
I20260201 08:59:49.335974 17277 raft_consensus.cc:2393] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:49.346185 18271 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.337342 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.331625 18327 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.352715 17794 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.320748 18300 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.358526 18132 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260201 08:59:49.360939 18182 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
W20260201 08:59:49.358579 18444 log.cc:927] Time spent T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
I20260201 08:59:49.362835 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:49.350396 17842 rpcz_store.cc:269] 0201 08:59:46.446112 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.482948 (+ 36836us) service_pool.cc:225] Handling call
0201 08:59:47.517908 (+1034960us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:49.349737 (+1831829us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54000e33d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:49.349883 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":880961536}
I20260201 08:59:49.322342 18413 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.344727 18430 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.366083 17177 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.368664 17177 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.352074 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:49.371348 17209 raft_consensus.cc:2393] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:49.373063 17281 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:49.373610 17177 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:49.355494 17128 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46082 (request call id 547) took 2925 ms (client timeout 2417 ms). Trace:
I20260201 08:59:49.376892 17177 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.296660 18433 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.378472 18279 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.374629 18085 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.379187 18163 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:49.430012 17847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 374) took 1840 ms. Trace:
I20260201 08:59:49.433115 17847 rpcz_store.cc:276] 0201 08:59:47.589862 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.429009 (+1839147us) service_pool.cc:225] Handling call
0201 08:59:49.429500 (+ 491us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.429693 (+ 193us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.429717 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.429762 (+ 45us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:49.429793 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.429844 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.429951 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":215424}
I20260201 08:59:49.434304 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.367991 18132 consensus_queue.cc:1048] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260201 08:59:49.364122 18327 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.435434 17847 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:49.438446 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.381155 18394 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.435027 18163 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:49.429352 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:49.429925 18360 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.441845 17285 raft_consensus.cc:1275] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:59:49.458392 17207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 379) took 1904 ms. Trace:
I20260201 08:59:49.455930 17175 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:49.454704 17845 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
W20260201 08:59:49.460953 17845 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39018 (request call id 489) took 2128 ms (client timeout 1980 ms). Trace:
I20260201 08:59:49.459583 17285 pending_rounds.cc:85] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Aborting all ops after (but not including) 1
I20260201 08:59:49.462240 17285 pending_rounds.cc:107] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:49.462410 17285 raft_consensus.cc:2889] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260201 08:59:49.462909 17845 rpcz_store.cc:269] 0201 08:59:47.332426 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.406749 (+ 74323us) service_pool.cc:225] Handling call
0201 08:59:49.296722 (+1889973us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:49.460892 (+164170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10135936}
I20260201 08:59:49.464480 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:49.465435 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.442159 18163 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.477351 18431 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.438457 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.441407 18167 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:49.483554 17248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:49.484417 17249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:49.443228 18406 raft_consensus.cc:2749] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.450455 18430 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:49.471370 18346 log.cc:927] Time spent T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 2.474s user 0.007s sys 0.015s
I20260201 08:59:49.475536 18277 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260201 08:59:49.512530 17176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:49.455749 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.480937 18366 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.521199 18366 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.523263 18366 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.474886 17842 raft_consensus.cc:2376] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3. Re-sending same reply.
I20260201 08:59:49.520187 17847 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:49.499419 18419 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.498953 18431 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:49.377251 17128 rpcz_store.cc:269] 0201 08:59:46.429758 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:46.432502 (+ 2744us) service_pool.cc:225] Handling call
0201 08:59:47.503730 (+1071228us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:49.355247 (+1851517us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54005cf154. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:49.355407 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1325650176}
I20260201 08:59:49.475220 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.525632 17134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:54328 (request call id 17) took 1171 ms. Trace:
I20260201 08:59:49.507802 17129 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:49.373096 18381 consensus_queue.cc:237] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.508154 17132 raft_consensus.cc:1240] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:49.532449 18271 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.533046 18300 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.541297 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:49.541531 18167 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:49.542294 17846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39002 (request call id 456) took 1169 ms (client timeout 1533 ms). Trace:
I20260201 08:59:49.542536 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:49.544353 18422 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.508886 18413 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.510767 18277 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:49.524070 18310 raft_consensus.cc:3055] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:49.547421 18431 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.546185 17134 rpcz_store.cc:276] 0201 08:59:48.353883 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.363492 (+ 9609us) service_pool.cc:225] Handling call
0201 08:59:49.525445 (+1161953us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540036e054. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b02344d3 00007f74b51f213a 00007f74ae78d934 00007f74ae78d8c2 00007f74ae78d7f1 00007f74ae78d76c 00007f74ae78ca22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:49.525552 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":457231616}
I20260201 08:59:49.545332 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.500744 18439 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.539731 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.569489 18277 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.533036 17280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54632 (request call id 567) took 1264 ms. Trace:
I20260201 08:59:49.546923 18419 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.562022 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:49.562191 17790 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:49.511353 18430 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.561208 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 595) took 1974 ms. Trace:
I20260201 08:59:49.568375 17794 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:49.565055 18246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.197s user 0.020s sys 0.014s
I20260201 08:59:49.545405 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.569020 18310 raft_consensus.cc:740] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:49.564035 17131 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:49.574189 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.576663 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.578557 18419 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.580789 18279 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:49.576689 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.578563 17843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 367) took 2249 ms. Trace:
I20260201 08:59:49.581704 17102 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.600980 17248 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:49.588392 18178 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.582976 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:49.559188 17846 rpcz_store.cc:269] 0201 08:59:48.372699 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.384517 (+ 11818us) service_pool.cc:225] Handling call
0201 08:59:49.542128 (+1157611us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400212354. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:49.542238 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":331401600}
I20260201 08:59:49.576700 17841 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:49.589592 18246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.237s user 0.020s sys 0.014s
I20260201 08:59:49.593797 18365 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.606339 17175 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:49.616762 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:49.607465 17250 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:49.620793 17250 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:49.600762 17843 rpcz_store.cc:276] 0201 08:59:47.329436 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.740742 (+411306us) service_pool.cc:225] Handling call
0201 08:59:47.764485 (+ 23743us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.262330 (+1497845us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.578365 (+316035us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001f7554. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:49.578511 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3401573760}
I20260201 08:59:49.599572 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.601301 18360 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:49.588130 18410 consensus_queue.cc:1048] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260201 08:59:49.627619 18450 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:49.629712 18450 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:49.630101 18450 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.573235 17280 rpcz_store.cc:276] 0201 08:59:48.268946 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.271497 (+ 2551us) service_pool.cc:225] Handling call
0201 08:59:48.336392 (+ 64895us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:48.353346 (+ 16954us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:48.353384 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:48.353428 (+ 44us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:48.353464 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.532721 (+1179257us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5400153e54. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:49.532794 (+ 73us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.532962 (+ 168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":25901952}
I20260201 08:59:49.605183 18419 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:49.608165 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.601929 17129 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:49.627707 18368 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.627494 18304 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:49.617022 18300 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.635536 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:49.660493 17175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:49.613202 17211 raft_consensus.cc:2468] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:49.652315 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.629042 18132 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:49.664779 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 366) took 2643 ms. Trace:
I20260201 08:59:49.657693 18361 consensus_queue.cc:1059] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260201 08:59:49.676486 17206 raft_consensus.cc:1240] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:49.650449 18441 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:49.629707 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.629885 18270 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.649541 18452 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:49.678998 18182 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.679461 17208 rpcz_store.cc:276] 0201 08:59:47.017471 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.167718 (+150247us) service_pool.cc:225] Handling call
0201 08:59:47.178609 (+ 10891us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.631923 (+453314us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.660614 (+2028691us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400398854. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:49.660817 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1041058176}
I20260201 08:59:49.680536 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.681165 18085 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:49.693866 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.686694 17793 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.694144 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.684211 18429 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.664371 18366 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.624191 18310 consensus_queue.cc:260] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.628111 18269 consensus_queue.cc:1059] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260201 08:59:49.714380 17211 raft_consensus.cc:2393] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:49.714546 18310 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.714697 18269 raft_consensus.cc:3055] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:49.715101 18269 raft_consensus.cc:740] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:49.702736 18163 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.715266 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.716447 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.716982 18163 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:49.704563 18431 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:49.718132 17210 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45884 (request call id 369) took 2672 ms (client timeout 2234 ms). Trace:
I20260201 08:59:49.717849 18366 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.719024 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.685366 18439 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.661437 17790 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:49.723308 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 90683.1us
I20260201 08:59:49.723308 17211 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632"
dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:45104
I20260201 08:59:49.724093 17211 raft_consensus.cc:606] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:49.724354 17790 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:49.607437 18178 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.725490 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.681282 18160 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.710768 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.711335 18246 raft_consensus.cc:2804] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:49.688225 18132 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:49.709143 17136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 381) took 2073 ms. Trace:
I20260201 08:59:49.721436 17250 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:49.710791 18452 raft_consensus.cc:697] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
W20260201 08:59:49.718513 17210 rpcz_store.cc:269] 0201 08:59:47.045388 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.171747 (+126359us) service_pool.cc:225] Handling call
0201 08:59:49.717927 (+2546180us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400398d54. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:49.718048 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":798131968}
I20260201 08:59:49.677196 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.707427 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.708850 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.709810 18175 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260201 08:59:49.728020 17282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54622 (request call id 590) took 2705 ms (client timeout 2009 ms). Trace:
I20260201 08:59:49.717057 18430 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.728780 17208 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:49.729403 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.730257 17843 raft_consensus.cc:1240] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:49.754464 17278 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.731479 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.732263 17793 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.755410 17281 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.737365 18132 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:49.721854 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.746858 18410 raft_consensus.cc:2804] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:49.722461 18368 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:49.768088 17847 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260201 08:59:49.770051 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:49.737552 17136 rpcz_store.cc:276] 0201 08:59:47.636079 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.816422 (+180343us) service_pool.cc:225] Handling call
0201 08:59:47.816676 (+ 254us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.816877 (+ 201us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 08:59:48.335206 (+518329us) log.cc:844] Serialized 14 byte log entry
0201 08:59:49.679910 (+1344704us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b1800426160. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab 00007f74afdd90c3 00007f74afdd95da 00007f74b02446aa
0201 08:59:49.708746 (+ 28836us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.708798 (+ 52us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:49.708849 (+ 51us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.708979 (+ 130us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.709093 (+ 114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":249,"prepare.queue_time_us":517607,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6383,"raft.queue_time_us":352,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3305,"spinlock_wait_cycles":11447168,"thread_start_us":28330,"threads_started":1}
I20260201 08:59:49.742198 18452 consensus_queue.cc:237] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.742867 18429 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.744021 18152 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:49.587349 17202 rpcz_store.cc:276] 0201 08:59:47.587255 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.346011 (+1758756us) service_pool.cc:225] Handling call
0201 08:59:49.377049 (+ 31038us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.410212 (+ 33163us) raft_consensus.cc:1534] Early marking committed up to index 2
0201 08:59:49.498543 (+ 88331us) log.cc:844] Serialized 14 byte log entry
0201 08:59:49.560784 (+ 62241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.560841 (+ 57us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:49.560919 (+ 78us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.561008 (+ 89us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.561156 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19237,"prepare.queue_time_us":37243,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":6998,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":1260800,"thread_start_us":95614,"threads_started":2,"wal-append.queue_time_us":61403}
I20260201 08:59:49.744576 17210 raft_consensus.cc:1240] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:49.744750 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:49.747659 17249 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:49.754590 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 75) took 1913 ms. Trace:
W20260201 08:59:49.754146 17282 rpcz_store.cc:269] 0201 08:59:47.022380 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.727830 (+2705450us) service_pool.cc:212] Skipping call since client already timed out
0201 08:59:49.727966 (+ 136us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260201 08:59:49.733326 18246 raft_consensus.cc:697] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:49.736974 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.677261 18300 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.728680 18365 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:49.764315 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 376) took 2339 ms. Trace:
I20260201 08:59:49.764833 18366 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.766214 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.766876 17841 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:49.767812 18455 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:49.774605 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:49.756160 17842 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:49.771659 17846 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
W20260201 08:59:49.802953 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 55399.9us
I20260201 08:59:49.805186 17208 rpcz_store.cc:276] 0201 08:59:47.841055 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.728331 (+1887276us) service_pool.cc:225] Handling call
0201 08:59:49.728626 (+ 295us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.754344 (+ 25718us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.754541 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.820199 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:49.763402 18410 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:49.762389 18182 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.807029 17204 rpcz_store.cc:276] 0201 08:59:47.425083 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.560255 (+135172us) service_pool.cc:225] Handling call
0201 08:59:47.560508 (+ 253us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.745166 (+184658us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.745197 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.745236 (+ 39us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:47.745264 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.764100 (+2018836us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54004e7354. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:49.764145 (+ 45us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.764264 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":424244480}
I20260201 08:59:49.810158 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.828898 17249 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:49.829277 17278 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:49.829119 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.830763 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 384) took 1003 ms. Trace:
I20260201 08:59:49.831609 17175 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:49.837430 17204 rpcz_store.cc:276] 0201 08:59:48.827047 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.829956 (+1002909us) service_pool.cc:225] Handling call
0201 08:59:49.830279 (+ 323us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.830446 (+ 167us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.830473 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.830519 (+ 46us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:49.830550 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.830606 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.830707 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.813715 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.761159 18430 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:49.810761 17276 raft_consensus.cc:2368] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3.
I20260201 08:59:49.806546 18377 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:49.753343 18269 consensus_queue.cc:260] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.839232 17278 raft_consensus.cc:1240] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:49.812249 17211 raft_consensus.cc:1275] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:49.841195 17843 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:49.841624 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.812353 17840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 438) took 3396 ms. Trace:
I20260201 08:59:49.816201 18455 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.845862 18336 consensus_queue.cc:1059] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:49.847137 18268 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.847759 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:49.842684 18441 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:49.845821 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 81) took 1271 ms. Trace:
I20260201 08:59:49.830974 18429 consensus_queue.cc:1059] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260201 08:59:49.852258 18363 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:49.852950 17842 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260201 08:59:49.854393 18246 consensus_queue.cc:237] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.844506 18377 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:49.856895 18430 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.862710 17208 raft_consensus.cc:1240] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:49.829090 18410 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.842799 18426 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:49.828408 18319 consensus_queue.cc:1059] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260201 08:59:49.877314 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.881733 18426 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:49.882225 18426 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:49.879014 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 383) took 1054 ms. Trace:
I20260201 08:59:49.882905 17208 rpcz_store.cc:276] 0201 08:59:48.824665 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.828744 (+1004079us) service_pool.cc:225] Handling call
0201 08:59:49.862527 (+ 33783us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.878809 (+ 16282us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.878968 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.883919 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:49.833004 18182 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.884141 18277 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:49.885891 18455 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.885914 18182 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.887064 18430 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.887930 17208 raft_consensus.cc:1240] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:49.888605 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 387) took 1013 ms. Trace:
I20260201 08:59:49.888959 17208 rpcz_store.cc:276] 0201 08:59:48.875400 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.887417 (+1012017us) service_pool.cc:225] Handling call
0201 08:59:49.887779 (+ 362us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.888394 (+ 615us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.888553 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:49.865952 18178 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.881438 17277 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:49.868486 18348 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:49.878163 18377 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:49.889057 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:49.902732 17839 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:49.880192 18441 raft_consensus.cc:697] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:49.893455 18268 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260201 08:59:49.876899 18363 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.896073 18348 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.902082 18300 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.889117 18430 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:49.930135 18441 consensus_queue.cc:237] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.933761 18262 raft_consensus.cc:3055] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:49.934340 18262 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:49.935210 18262 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:49.938582 18360 raft_consensus.cc:3055] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:49.939139 18360 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:49.938608 18450 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:49.939985 18360 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:49.958370 18360 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.973651 18262 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:49.995225 18348 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:49.996614 18450 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:50.028486 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.031450 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.033658 17129 raft_consensus.cc:2410] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 08:59:50.035104 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.037146 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.037386 17103 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:50.038739 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.039592 17129 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.040251 17130 raft_consensus.cc:2410] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260201 08:59:50.048887 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.052171 17102 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.053196 17129 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:50.054567 17102 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:50.055090 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.056886 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.852970 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.059052 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.059962 17134 raft_consensus.cc:2410] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 08:59:50.060572 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.862533 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.061085 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.890899 17205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 377) took 2465 ms. Trace:
I20260201 08:59:49.868337 17211 rpcz_store.cc:276] 0201 08:59:48.574104 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.752926 (+1178822us) service_pool.cc:225] Handling call
0201 08:59:49.773341 (+ 20415us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.845571 (+ 72230us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.845769 (+ 198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:50.062587 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:49.860812 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.069119 17136 raft_consensus.cc:2410] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 08:59:49.914115 17281 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:50.061059 17102 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.062800 17205 rpcz_store.cc:276] 0201 08:59:47.425323 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.609638 (+184315us) service_pool.cc:225] Handling call
0201 08:59:47.656791 (+ 47153us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:47.698505 (+ 41714us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.698538 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:47.698581 (+ 43us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:47.698617 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.875691 (+2177074us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b5400400bd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:49.876490 (+ 799us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.890036 (+ 13546us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":95441280}
I20260201 08:59:49.905282 17794 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.062412 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:50.116461 18317 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.117162 17134 raft_consensus.cc:606] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:50.077847 17278 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:50.065591 17211 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 08:59:49.861466 17840 rpcz_store.cc:276] 0201 08:59:46.411187 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.004454 (+593267us) service_pool.cc:225] Handling call
0201 08:59:47.507367 (+502913us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:47.507567 (+ 200us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:47.583568 (+ 76001us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:47.583602 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:47.584105 (+ 503us) log.cc:844] Serialized 26 byte log entry
0201 08:59:47.663621 (+ 79516us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:47.667481 (+ 3860us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.769326 (+2101845us) spinlock_profiling.cc:243] Waited 75.6 ms on lock 0x7b54000082d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:49.773003 (+ 3677us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:49.773848 (+ 845us) raft_consensus.cc:1685] finished
0201 08:59:49.773863 (+ 15us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.807343 (+ 33480us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":286,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":189581440,"thread_start_us":47468,"threads_started":1,"wal-append.queue_time_us":216556,"wal-append.run_cpu_time_us":1832,"wal-append.run_wall_time_us":1085033}
I20260201 08:59:50.119050 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 601) took 1224 ms. Trace:
W20260201 08:59:50.119421 17175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.120237 17840 raft_consensus.cc:1240] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:50.082718 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.122193 18321 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:50.122983 18321 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:50.123823 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.123383 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.125351 18361 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:50.126353 18361 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.126818 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.129514 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.129740 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.130364 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:50.131206 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.134310 18377 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.117710 17134 raft_consensus.cc:614] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:50.061574 17129 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:50.084807 17848 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39018 (request call id 494) took 1023 ms. Trace:
I20260201 08:59:50.086853 17843 raft_consensus.cc:1240] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
W20260201 08:59:50.078137 17251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:49.955948 18132 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:50.137580 17848 rpcz_store.cc:276] 0201 08:59:49.063481 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.814890 (+751409us) service_pool.cc:225] Handling call
0201 08:59:49.815230 (+ 340us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:49.815568 (+ 338us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.815598 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:49.820943 (+ 5345us) log.cc:844] Serialized 26 byte log entry
0201 08:59:49.916215 (+ 95272us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:49.916255 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.916321 (+ 66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:50.084319 (+167998us) raft_consensus.cc:1685] finished
0201 08:59:50.084353 (+ 34us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.084610 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1481,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8542,"thread_start_us":66993,"threads_started":1,"wal-append.queue_time_us":130200}
I20260201 08:59:50.091897 18175 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 08:59:50.141059 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 80266.5us
I20260201 08:59:50.141302 18175 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.142174 17102 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:50.142799 17136 raft_consensus.cc:1275] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:59:50.143226 17136 pending_rounds.cc:85] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 1
I20260201 08:59:50.143312 17102 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.143808 18175 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:50.094066 18277 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:50.099020 18178 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:50.144579 18362 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.145134 18362 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:50.145591 18362 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.146067 18132 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:50.145172 18178 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:50.144490 18425 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.151994 18310 consensus_queue.cc:1048] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260201 08:59:50.117694 18317 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:50.153244 18334 consensus_queue.cc:1059] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:50.153868 18317 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:50.119709 17211 rpcz_store.cc:276] 0201 08:59:48.894475 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.064063 (+1169588us) service_pool.cc:225] Handling call
0201 08:59:50.064947 (+ 884us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:50.118584 (+ 53637us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.118941 (+ 357us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:50.151572 18430 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:50.155440 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.155275 18430 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:50.156304 17211 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.099431 18271 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:50.071229 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 388) took 1193 ms. Trace:
I20260201 08:59:50.109730 18426 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.111474 18198 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:50.132587 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.154340 18317 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:50.157626 17136 pending_rounds.cc:107] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:50.150178 17206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 378) took 2724 ms. Trace:
I20260201 08:59:50.150578 18178 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:50.155361 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.168355 17136 raft_consensus.cc:2889] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:50.159051 17208 rpcz_store.cc:276] 0201 08:59:48.877899 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.890019 (+1012120us) service_pool.cc:225] Handling call
0201 08:59:50.069822 (+179803us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.070567 (+ 745us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:50.070619 (+ 52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:50.070687 (+ 68us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:50.070754 (+ 67us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.070836 (+ 82us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.070981 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":24050,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187}
I20260201 08:59:50.164942 17206 rpcz_store.cc:276] 0201 08:59:47.425553 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.640337 (+214784us) service_pool.cc:225] Handling call
0201 08:59:49.617085 (+1976748us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:49.669635 (+ 52550us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.702701 (+ 33066us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.149697 (+446996us) spinlock_profiling.cc:243] Waited 52.3 ms on lock 0x7b54003facd0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.149942 (+ 245us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":174081280}
W20260201 08:59:50.171272 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 60707.9us
I20260201 08:59:50.171896 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.172207 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.172362 17174 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.173190 17208 raft_consensus.cc:2393] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:50.174136 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.174459 17280 raft_consensus.cc:1240] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260201 08:59:50.175889 17205 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:50.159492 17202 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:50.177564 17205 raft_consensus.cc:1275] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:50.178931 17205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 82) took 1189 ms. Trace:
I20260201 08:59:50.179316 17202 raft_consensus.cc:1240] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:50.180325 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 84) took 1034 ms. Trace:
I20260201 08:59:50.181342 18198 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:50.182070 17847 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 385) took 1128 ms. Trace:
I20260201 08:59:50.182479 17847 rpcz_store.cc:276] 0201 08:59:49.053304 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.770996 (+717692us) service_pool.cc:225] Handling call
0201 08:59:49.771291 (+ 295us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.846669 (+ 75378us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:49.846698 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.846737 (+ 39us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:49.846766 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.181644 (+334878us) spinlock_profiling.cc:243] Waited 75.2 ms on lock 0x7b54000073d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:50.181710 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.181892 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":172929792}
I20260201 08:59:50.183573 18198 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:50.136451 17790 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.192341 17206 raft_consensus.cc:2393] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
W20260201 08:59:50.197734 18349 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260201 08:59:50.198438 18349 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:50.199190 17174 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.200284 18118 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:50.201435 17177 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:50.203205 18321 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:50.175949 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.207147 18240 consensus_queue.cc:1059] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260201 08:59:50.208997 17134 raft_consensus.cc:1240] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:50.212602 18361 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:50.214005 18132 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
W20260201 08:59:50.214347 17284 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54632 (request call id 573) took 1880 ms (client timeout 2018 ms). Trace:
I20260201 08:59:50.214614 18132 raft_consensus.cc:697] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:50.215869 18132 consensus_queue.cc:237] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.216759 18426 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:50.217669 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 74578.5us
I20260201 08:59:50.218459 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.191332 18271 raft_consensus.cc:697] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
W20260201 08:59:50.218250 17284 rpcz_store.cc:269] 0201 08:59:48.334177 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.334307 (+ 130us) service_pool.cc:225] Handling call
0201 08:59:50.175589 (+1841282us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:50.214270 (+ 38681us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5792128}
I20260201 08:59:50.228562 17250 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.218614 18377 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:50.228462 18450 consensus_queue.cc:1059] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:50.231674 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:50.180739 17202 rpcz_store.cc:276] 0201 08:59:49.145804 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.178358 (+1032554us) service_pool.cc:225] Handling call
0201 08:59:50.178942 (+ 584us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.179965 (+ 1023us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.180241 (+ 276us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:50.219544 18430 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:50.189256 17205 rpcz_store.cc:276] 0201 08:59:48.989503 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.176730 (+1187227us) service_pool.cc:225] Handling call
0201 08:59:50.177137 (+ 407us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.178602 (+ 1465us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.178848 (+ 246us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 08:59:50.234169 18413 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:50.235293 18450 raft_consensus.cc:3055] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:50.235087 18189 consensus_queue.cc:1059] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260201 08:59:50.235680 17131 consensus_meta.cc:287] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.562s user 0.005s sys 0.015s
I20260201 08:59:50.235787 17210 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260201 08:59:50.236243 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.235544 17174 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.237977 18304 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.242288 18160 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.243254 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.244097 17284 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:50.244760 17793 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:50.245048 17210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 386) took 1404 ms. Trace:
I20260201 08:59:50.245610 17129 raft_consensus.cc:1275] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:50.246053 17131 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:50.246734 17131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54340 (request call id 90) took 1101 ms. Trace:
I20260201 08:59:50.247387 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:50.247236 17131 rpcz_store.cc:276] 0201 08:59:49.145492 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.146917 (+ 1425us) service_pool.cc:225] Handling call
0201 08:59:49.541182 (+394265us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f12e 000000000035a3c9 00007f74b5179560 00007f74b5241dd4 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:50.246640 (+705458us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15643904}
I20260201 08:59:50.248462 17847 raft_consensus.cc:2368] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 08:59:50.251541 17205 raft_consensus.cc:1240] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:50.253227 17206 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:50.256619 17211 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:50.245461 17210 rpcz_store.cc:276] 0201 08:59:48.840442 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.841660 (+1001218us) service_pool.cc:225] Handling call
0201 08:59:50.156932 (+315272us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:50.219522 (+ 62590us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.239560 (+ 20038us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.244967 (+ 5407us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19153280}
I20260201 08:59:50.238149 18450 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:50.257948 18271 consensus_queue.cc:237] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.266305 17131 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:50.275571 17208 raft_consensus.cc:1240] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:50.269292 17249 leader_election.cc:400] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 08:59:50.277482 17249 leader_election.cc:403] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260201 08:59:50.267795 17102 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.272315 18269 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:50.269106 18327 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:50.280115 18362 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:50.280889 18422 consensus_queue.cc:1059] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:50.272627 18426 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.282305 18422 raft_consensus.cc:3055] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:50.270555 18160 consensus_queue.cc:1048] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260201 08:59:50.282768 18422 raft_consensus.cc:740] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:50.273063 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:50.283860 18189 raft_consensus.cc:3060] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.283777 18422 consensus_queue.cc:260] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:50.289430 18422 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.284544 17848 raft_consensus.cc:1240] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:50.260809 17205 raft_consensus.cc:1275] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:50.261960 18304 raft_consensus.cc:3055] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:50.315999 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:49.459745 17207 rpcz_store.cc:276] 0201 08:59:47.553836 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.298775 (+1744939us) service_pool.cc:225] Handling call
0201 08:59:49.326310 (+ 27535us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:49.326463 (+ 153us) raft_consensus.cc:1534] Early marking committed up to index 2
0201 08:59:49.364451 (+ 37988us) log.cc:844] Serialized 14 byte log entry
0201 08:59:49.458087 (+ 93636us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.458138 (+ 51us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:49.458177 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.458240 (+ 63us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:49.458343 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":104875,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":1430,"raft.queue_time_us":1020,"thread_start_us":121132,"threads_started":2}
I20260201 08:59:50.278640 18413 consensus_queue.cc:1048] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260201 08:59:50.293231 17136 raft_consensus.cc:1275] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:50.315282 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.316004 17847 raft_consensus.cc:1240] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:50.244678 18410 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.300498 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:50.320979 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.323655 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:50.326102 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.329382 17136 raft_consensus.cc:2368] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 08:59:50.268806 18433 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:50.316972 18304 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:50.336695 17133 raft_consensus.cc:1240] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
W20260201 08:59:50.343626 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 75961.9us
I20260201 08:59:50.364219 17848 raft_consensus.cc:1240] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
W20260201 08:59:50.362663 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 101187us
I20260201 08:59:50.348512 18163 raft_consensus.cc:3055] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:50.349002 18425 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.345140 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.358016 18160 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:50.372810 17102 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.366076 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.374655 17248 leader_election.cc:400] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 08:59:50.376531 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:50.376225 17250 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.402379 18362 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:50.404333 18410 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:50.405256 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:50.374064 18304 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.378890 17203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 585) took 3204 ms. Trace:
I20260201 08:59:50.369508 18163 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:50.393177 18189 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 08:59:50.376717 17132 raft_consensus.cc:1240] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:50.408479 17103 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.375412 18351 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:50.378772 18428 raft_consensus.cc:3055] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:50.411926 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:50.415503 18365 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260201 08:59:50.415995 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 314847us
I20260201 08:59:50.416236 18246 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260201 08:59:50.416249 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 171723us
I20260201 08:59:50.378029 17137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54340 (request call id 89) took 2190 ms. Trace:
I20260201 08:59:50.417189 17841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39018 (request call id 509) took 1179 ms. Trace:
I20260201 08:59:50.417871 18381 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.395879 18450 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.406744 17203 rpcz_store.cc:276] 0201 08:59:47.174685 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.299149 (+124464us) service_pool.cc:225] Handling call
0201 08:59:47.497238 (+198089us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:47.926794 (+429556us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:49.349006 (+1422212us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54004e6e54. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:50.378414 (+1029408us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54004e6e50. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.378667 (+ 253us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1130305024}
I20260201 08:59:50.432654 17839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 474) took 1230 ms. Trace:
I20260201 08:59:50.433746 18269 consensus_queue.cc:1059] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260201 08:59:50.435428 17844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39002 (request call id 457) took 2062 ms (client timeout 1840 ms). Trace:
W20260201 08:59:50.435918 17844 rpcz_store.cc:269] 0201 08:59:48.373087 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.384550 (+ 11463us) service_pool.cc:225] Handling call
0201 08:59:49.176630 (+792080us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f12e 000000000035a3c9 00007f74b5179560 00007f74b5241dd4 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:50.435024 (+1258394us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b5400211954. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.435232 (+ 208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":216906240}
I20260201 08:59:50.433151 17839 rpcz_store.cc:276] 0201 08:59:49.202462 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.903549 (+701087us) service_pool.cc:225] Handling call
0201 08:59:49.916524 (+ 12975us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.078624 (+162100us) raft_consensus.cc:1534] Early marking committed up to index 2
0201 08:59:50.208570 (+129946us) log.cc:844] Serialized 14 byte log entry
0201 08:59:50.432134 (+223564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:50.432187 (+ 53us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:50.432233 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.432333 (+ 100us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.432484 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":96087,"prepare.queue_time_us":141954,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":902,"raft.queue_time_us":100599,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":208520,"threads_started":2}
I20260201 08:59:50.438009 18185 raft_consensus.cc:3055] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:50.438422 18185 raft_consensus.cc:740] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:50.435781 17845 raft_consensus.cc:1240] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:50.438796 17843 raft_consensus.cc:1240] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:50.420926 18428 raft_consensus.cc:740] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:50.429535 18381 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:50.443234 17134 raft_consensus.cc:1275] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:50.451429 18268 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260201 08:59:50.453351 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 77219.2us
I20260201 08:59:50.439354 18185 consensus_queue.cc:260] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.449550 18163 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.450917 18381 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.460358 18185 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:50.460600 18163 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:50.470986 18474 log.cc:927] Time spent T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.105s user 0.001s sys 0.000s
I20260201 08:59:50.486653 17847 raft_consensus.cc:1240] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260201 08:59:50.489530 17842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 475) took 1264 ms. Trace:
I20260201 08:59:50.489985 17842 rpcz_store.cc:276] 0201 08:59:49.225012 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.087364 (+862352us) service_pool.cc:225] Handling call
0201 08:59:50.087892 (+ 528us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:50.148615 (+ 60723us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:50.148672 (+ 57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:50.149567 (+ 895us) log.cc:844] Serialized 26 byte log entry
0201 08:59:50.201169 (+ 51602us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:50.201228 (+ 59us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.201324 (+ 96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:50.489195 (+287871us) raft_consensus.cc:1685] finished
0201 08:59:50.489216 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.489367 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12890,"raft.queue_time_us":65700,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":224,"thread_start_us":50732,"threads_started":1,"wal-append.queue_time_us":110720}
I20260201 08:59:50.427240 17137 rpcz_store.cc:276] 0201 08:59:48.187078 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.361250 (+174172us) service_pool.cc:225] Handling call
0201 08:59:48.429791 (+ 68541us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:48.814922 (+385131us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 08:59:48.877617 (+ 62695us) log.cc:844] Serialized 14 byte log entry
0201 08:59:49.448528 (+570911us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18001c9ea0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad189335 00007f74b0231ce0 00007f74b0244396 00007f74b0254f07 00007f74b0254e88
0201 08:59:49.507317 (+ 58789us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:49.510968 (+ 3651us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:49.517684 (+ 6716us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.377528 (+859844us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54004d03d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:50.377603 (+ 75us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.377831 (+ 228us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":50757,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":147909,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":9716,"spinlock_wait_cycles":867818624,"thread_start_us":54634,"threads_started":1}
I20260201 08:59:50.427098 17841 rpcz_store.cc:276] 0201 08:59:49.237267 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.082551 (+845284us) service_pool.cc:225] Handling call
0201 08:59:50.083219 (+ 668us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.083623 (+ 404us) raft_consensus.cc:1534] Early marking committed up to index 2
0201 08:59:50.165962 (+ 82339us) log.cc:844] Serialized 14 byte log entry
0201 08:59:50.416612 (+250650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:50.416672 (+ 60us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:50.416766 (+ 94us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.416849 (+ 83us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.417009 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":194346,"prepare.queue_time_us":148505,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":195854,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":122302,"threads_started":2,"wal-append.queue_time_us":69643}
I20260201 08:59:50.456275 18351 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:50.478653 17130 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 373) took 2844 ms (client timeout 2288 ms). Trace:
W20260201 08:59:50.478962 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 573634us
I20260201 08:59:50.483243 18450 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:50.471514 18246 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260201 08:59:50.485244 18304 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.488624 18274 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:50.497844 18441 consensus_queue.cc:1059] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:50.499126 18316 raft_consensus.cc:3055] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:50.499496 18316 raft_consensus.cc:740] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
W20260201 08:59:50.496031 17130 rpcz_store.cc:269] 0201 08:59:47.633986 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:47.758868 (+124882us) service_pool.cc:225] Handling call
0201 08:59:50.478402 (+2719534us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b5400640854. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.478564 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4982979328}
I20260201 08:59:50.500689 18363 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:50.500423 18316 consensus_queue.cc:260] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.501709 18316 raft_consensus.cc:3060] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:50.502668 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 58723.7us
I20260201 08:59:50.503614 17790 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:50.486596 18428 consensus_queue.cc:260] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.502857 17130 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:59:50.506160 17249 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.507283 18425 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:50.507802 18425 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.508018 18441 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.508459 18441 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:50.508800 18441 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.509019 18246 raft_consensus.cc:2804] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:50.509562 18246 raft_consensus.cc:697] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:50.510483 18246 consensus_queue.cc:237] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.506126 18428 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:50.468632 18189 consensus_queue.cc:1059] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260201 08:59:50.508821 17250 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.513836 18243 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.506525 17204 raft_consensus.cc:1240] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:50.507454 17130 pending_rounds.cc:85] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 1
I20260201 08:59:50.529131 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 385) took 1697 ms. Trace:
I20260201 08:59:50.531076 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:50.529624 17204 rpcz_store.cc:276] 0201 08:59:48.828664 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.838296 (+1009632us) service_pool.cc:225] Handling call
0201 08:59:50.505954 (+667658us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:50.506239 (+ 285us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.523819 (+ 17580us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.525698 (+ 1879us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27387776}
I20260201 08:59:50.524427 17130 pending_rounds.cc:107] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:50.540930 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.541529 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:50.541764 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:50.542578 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.543362 17175 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:50.544566 17175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.504733 17790 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.545367 17250 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.546700 18277 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.547632 18123 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:50.547422 18269 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:50.543412 17282 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:50.493332 18317 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:50.483299 18381 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:50.561592 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 196129us
I20260201 08:59:50.548969 17130 raft_consensus.cc:2889] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260201 08:59:50.567137 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 158702us
I20260201 08:59:50.568017 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.568608 18198 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:50.564237 18362 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.577787 17102 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.578294 18336 raft_consensus.cc:3055] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:50.578768 18336 raft_consensus.cc:740] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:50.579862 18427 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:50.579598 18336 consensus_queue.cc:260] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:50.581175 17276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54632 (request call id 570) took 2311 ms (client timeout 2160 ms). Trace:
W20260201 08:59:50.581594 17276 rpcz_store.cc:269] 0201 08:59:48.269829 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:48.271753 (+ 1924us) service_pool.cc:225] Handling call
0201 08:59:49.664627 (+1392874us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:50.580737 (+916110us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b5400002b54. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.580982 (+ 245us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":151873024}
I20260201 08:59:50.553424 18351 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:50.555703 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 51101us
I20260201 08:59:50.583352 17285 raft_consensus.cc:1275] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:50.584405 17790 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:50.577787 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.585935 18430 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.586362 18430 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:50.586733 18430 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.586952 17285 raft_consensus.cc:1240] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:50.590173 18279 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:50.579615 17102 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:50.523392 18413 consensus_queue.cc:1175] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35484ac93d564e958f85965bd740a18f" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 08:59:50.592401 18427 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.592782 18427 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:50.593143 18427 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.593339 18336 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:50.594352 17250 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.598614 17174 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.599498 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.556018 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:50.608457 18186 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.613503 18123 consensus_queue.cc:1059] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260201 08:59:50.616045 18123 raft_consensus.cc:3055] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:50.616266 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.616539 18167 consensus_queue.cc:1048] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:50.617511 17206 raft_consensus.cc:1275] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:59:50.618037 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:50.608462 18185 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:50.619031 18185 raft_consensus.cc:697] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:50.619956 18185 consensus_queue.cc:237] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:50.612126 18334 consensus_queue.cc:1059] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260201 08:59:50.622047 18334 raft_consensus.cc:3055] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:50.621948 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:50.622474 18334 raft_consensus.cc:740] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:50.623302 18334 consensus_queue.cc:260] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.624516 18334 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.624758 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.625546 18123 raft_consensus.cc:740] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
W20260201 08:59:50.626873 17793 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:50.626559 18123 consensus_queue.cc:260] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.602177 18132 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:50.627601 18132 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.627856 18123 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:50.629828 18317 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:50.629567 18132 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:50.631870 18485 log.cc:927] Time spent T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20260201 08:59:50.632555 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.632979 17174 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.633941 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.635411 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:50.609376 18189 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260201 08:59:50.654610 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.656584 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:50.660676 17794 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.654475 18268 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260201 08:59:50.661757 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:50.665316 18381 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:50.665704 18126 consensus_queue.cc:1059] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:50.666786 18126 raft_consensus.cc:3055] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 08:59:50.667091 18126 raft_consensus.cc:740] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:50.669142 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.650378 18167 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260201 08:59:50.670812 17135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 397) took 1515 ms. Trace:
I20260201 08:59:50.638322 17839 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:50.667958 18126 consensus_queue.cc:260] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.671226 17135 rpcz_store.cc:276] 0201 08:59:49.155456 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.157460 (+ 2004us) service_pool.cc:225] Handling call
0201 08:59:50.479242 (+1321782us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.565341 (+ 86099us) raft_consensus.cc:1534] Early marking committed up to index 1
0201 08:59:50.565370 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:50.565408 (+ 38us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:50.571061 (+ 5653us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.571154 (+ 93us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:50.670516 (+ 99362us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400640850. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.670641 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":83106,"raft.queue_time_us":87951,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"spinlock_wait_cycles":3037804416}
W20260201 08:59:50.676757 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:50.677784 18481 log.cc:927] Time spent T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.248s user 0.001s sys 0.003s
I20260201 08:59:50.681592 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.681957 17283 raft_consensus.cc:2468] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:50.683413 18327 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:50.683609 17278 raft_consensus.cc:1275] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 08:59:50.683957 18327 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:50.685254 17128 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:50.685882 18410 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.686762 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.689603 18189 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:50.683733 17848 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:50.674621 17794 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.703965 17174 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.706123 17249 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.710260 17131 raft_consensus.cc:606] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Received request to transfer leadership to TS f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.710737 17131 raft_consensus.cc:614] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:50.713225 18406 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.720356 17128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46082 (request call id 571) took 1060 ms. Trace:
I20260201 08:59:50.721752 17132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 406) took 1213 ms. Trace:
I20260201 08:59:50.722224 18351 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260201 08:59:50.726235 18493 log.cc:927] Time spent T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.073s user 0.001s sys 0.000s
W20260201 08:59:50.727938 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 50573.7us
I20260201 08:59:50.699293 17130 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 08:59:50.733633 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 59111.4us
I20260201 08:59:50.735796 18425 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.702211 18410 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:50.746027 17177 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.757977 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.741304 18118 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.758837 18118 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 08:59:50.759465 18118 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:50.759315 18132 consensus_queue.cc:1048] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:50.760960 18126 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
W20260201 08:59:50.761761 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 86679.3us
I20260201 08:59:50.767978 18441 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.720847 17128 rpcz_store.cc:276] 0201 08:59:49.660189 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.686346 (+ 26157us) service_pool.cc:225] Handling call
0201 08:59:50.720153 (+1033807us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54001dd8d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.720292 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2142398336}
I20260201 08:59:50.762316 17283 raft_consensus.cc:1275] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:59:50.778016 17283 pending_rounds.cc:85] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Aborting all ops after (but not including) 1
I20260201 08:59:50.778357 17283 pending_rounds.cc:107] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:50.778625 17283 raft_consensus.cc:2889] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:50.780018 18348 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.722178 17132 rpcz_store.cc:276] 0201 08:59:49.508580 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.147717 (+639137us) service_pool.cc:225] Handling call
0201 08:59:50.148147 (+ 430us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.420058 (+271911us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.721510 (+301452us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400273654. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:50.721694 (+ 184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":406896000}
I20260201 08:59:50.771876 17845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 381) took 1700 ms. Trace:
I20260201 08:59:50.781677 17845 rpcz_store.cc:276] 0201 08:59:49.052296 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:49.469778 (+417482us) service_pool.cc:225] Handling call
0201 08:59:50.435428 (+965650us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.440498 (+ 5070us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.743965 (+303467us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400211950. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.752607 (+ 8642us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2220061952}
I20260201 08:59:50.782406 17280 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:50.771445 18427 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:50.786530 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.788075 17174 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.789036 17284 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:50.790683 18426 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:50.791368 18426 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.792235 17794 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.796440 17174 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.780056 18425 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:50.827265 18427 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:50.830246 18450 consensus_queue.cc:1059] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:50.797386 18365 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.831071 18365 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:50.831471 17174 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:50.830739 18163 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:50.833834 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 602) took 1935 ms. Trace:
I20260201 08:59:50.834264 17208 rpcz_store.cc:276] 0201 08:59:48.898246 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.175009 (+1276763us) service_pool.cc:225] Handling call
0201 08:59:50.258715 (+ 83706us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:50.299469 (+ 40754us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:50.833642 (+534173us) spinlock_profiling.cc:243] Waited 83.4 ms on lock 0x7b5400570150. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:50.833774 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":191719168}
I20260201 08:59:50.836185 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:50.803040 18316 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260201 08:59:50.843793 17210 raft_consensus.cc:2468] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:50.841145 18270 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:50.831501 18365 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:50.845590 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:50.851866 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 265663us
W20260201 08:59:50.852165 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 94266.1us
I20260201 08:59:50.850168 18413 consensus_queue.cc:1059] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260201 08:59:50.854668 18246 consensus_queue.cc:1048] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260201 08:59:50.851092 18425 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260201 08:59:50.867067 17276 raft_consensus.cc:1275] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260201 08:59:50.867707 18348 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:50.868160 18348 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:50.869947 18492 log.cc:927] Time spent T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.216s user 0.002s sys 0.000s
I20260201 08:59:50.869676 18430 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:50.872117 18430 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:50.872697 18441 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:50.875303 17794 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.881729 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.874315 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.882375 17136 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.888933 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:50.881568 18327 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:50.889838 17284 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
W20260201 08:59:50.891592 18494 log.cc:927] Time spent T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.166s user 0.004s sys 0.000s
I20260201 08:59:50.872020 18316 raft_consensus.cc:3055] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:50.897872 17103 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:50.902917 18425 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:50.905555 18425 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:50.905963 18425 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.901854 18430 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:50.910151 18430 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:50.910568 18430 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:50.911388 18365 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.913655 18365 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:50.897746 18316 raft_consensus.cc:740] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:50.916574 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.917501 17205 raft_consensus.cc:2393] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:50.913892 17131 pending_rounds.cc:85] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 1
I20260201 08:59:50.919353 17131 pending_rounds.cc:107] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:50.919627 17131 raft_consensus.cc:2889] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:50.923851 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:50.926873 17101 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.885840 18427 consensus_queue.cc:1048] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260201 08:59:50.908757 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:50.934006 18317 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:50.943990 17284 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:50.945072 17794 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:50.931090 18316 consensus_queue.cc:260] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:50.943408 18317 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:50.953342 18317 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:50.955602 18430 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:50.945345 17840 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.947930 18410 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
W20260201 08:59:50.962579 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 115507us
I20260201 08:59:50.962906 18426 consensus_queue.cc:1048] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:50.964018 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:50.964761 17208 raft_consensus.cc:2393] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:50.965348 18426 consensus_queue.cc:1048] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:50.966866 18430 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:50.964751 18490 log.cc:927] Time spent T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.165s user 0.003s sys 0.000s
I20260201 08:59:50.971979 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:50.969295 18500 log.cc:927] Time spent T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.079s user 0.000s sys 0.002s
I20260201 08:59:50.985881 18316 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:50.986829 17174 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.988013 17174 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.989871 17174 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:50.982924 18413 raft_consensus.cc:3055] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:50.994596 17793 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:50.980643 18410 raft_consensus.cc:697] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:50.994591 17101 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:50.996505 18497 log.cc:927] Time spent T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.156s user 0.003s sys 0.000s
I20260201 08:59:50.999980 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:50.980625 18348 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:50.994261 18163 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:51.015790 17845 raft_consensus.cc:1275] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:51.011312 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:50.997525 18413 raft_consensus.cc:740] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:51.005280 18362 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:51.025480 17284 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:51.006760 18277 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260201 08:59:51.013485 18498 log.cc:927] Time spent T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.126s user 0.001s sys 0.000s
I20260201 08:59:51.028744 17794 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:51.012171 18270 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:51.010329 18365 raft_consensus.cc:2804] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:51.031455 17174 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:51.031769 18502 log.cc:927] Time spent T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.090s user 0.003s sys 0.000s
I20260201 08:59:50.996794 18132 consensus_queue.cc:1048] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260201 08:59:51.030704 18503 log.cc:927] Time spent T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.082s user 0.001s sys 0.000s
I20260201 08:59:51.045135 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:51.055574 16958 catalog_manager.cc:5654] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 3 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:51.056847 18365 raft_consensus.cc:697] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:51.057188 18428 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:51.057571 18428 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:51.057912 18428 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:51.059122 17845 raft_consensus.cc:1275] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:51.059283 18410 consensus_queue.cc:237] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.056955 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260201 08:59:51.062873 18413 consensus_queue.cc:260] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:51.048708 18167 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:51.064208 18167 raft_consensus.cc:697] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:51.065176 18167 consensus_queue.cc:237] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.047451 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:51.032416 17137 raft_consensus.cc:1240] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:51.038955 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:51.063674 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:51.074149 16958 catalog_manager.cc:5654] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 3 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:51.094039 16958 catalog_manager.cc:5654] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 3 to 4, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:51.097297 16958 catalog_manager.cc:5654] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 3 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 08:59:51.102681 16958 catalog_manager.cc:5654] T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 4, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:51.108775 17285 raft_consensus.cc:1275] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:51.082259 17276 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260201 08:59:51.113736 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 87203.1us
I20260201 08:59:51.114868 17102 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:51.112952 16958 catalog_manager.cc:5654] T 23892c545fda4a0ba2e3d29d32230ba3 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 3 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:51.054258 18160 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260201 08:59:51.116063 17102 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:51.115900 16958 catalog_manager.cc:5654] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 3 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:51.118465 16958 catalog_manager.cc:5654] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 08:59:51.120599 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:51.126310 18262 consensus_queue.cc:1048] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:51.106510 17130 raft_consensus.cc:1240] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260201 08:59:51.126852 16958 catalog_manager.cc:5654] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 3, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 3 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
W20260201 08:59:51.128223 18509 log.cc:927] Time spent T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20260201 08:59:51.128952 18271 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:51.131989 18413 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:51.128204 16958 catalog_manager.cc:5654] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 08:59:51.147936 17136 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:51.155455 18272 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:51.152403 16958 catalog_manager.cc:5654] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 4, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 4 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
W20260201 08:59:51.101984 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 48034us
I20260201 08:59:51.165170 17248 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:51.168711 17285 raft_consensus.cc:1275] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:51.167352 16958 catalog_manager.cc:5654] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 3 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 08:59:51.057973 18365 consensus_queue.cc:237] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:51.173862 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:51.194180 17101 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:51.194628 17845 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:51.107496 18277 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260201 08:59:51.179100 17839 raft_consensus.cc:1240] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:51.180029 18317 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:51.161583 18186 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.192467 18348 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:51.203652 16958 catalog_manager.cc:5654] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 4, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:51.196614 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:51.172560 18336 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:51.221380 16958 catalog_manager.cc:5654] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 2, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 2 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:51.203011 18160 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:51.174311 18425 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:51.205161 18349 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.249706 16958 catalog_manager.cc:5654] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
W20260201 08:59:51.263049 17249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:51.264181 16958 catalog_manager.cc:5654] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 3 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
W20260201 08:59:51.248092 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 134070us
I20260201 08:59:51.287391 18349 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.216264 18186 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.302100 18349 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:51.303372 18186 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:51.304181 17847 raft_consensus.cc:1240] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:51.306313 18426 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:51.306877 18426 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.308108 18425 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:51.308988 18422 consensus_queue.cc:1059] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:51.309929 18422 raft_consensus.cc:3055] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:51.310248 18422 raft_consensus.cc:740] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:51.310961 18422 consensus_queue.cc:260] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:51.312225 18422 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:51.201422 18272 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260201 08:59:51.308703 18426 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:51.313522 18272 raft_consensus.cc:3055] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:51.313917 18272 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:51.314694 18272 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:51.269200 18336 raft_consensus.cc:697] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:51.315863 18272 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:51.300488 18501 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.146s
W20260201 08:59:51.372246 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 201651us
I20260201 08:59:51.372218 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:51.403095 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 94643.1us
I20260201 08:59:51.380733 18426 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:51.419365 17202 raft_consensus.cc:1275] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260201 08:59:51.422029 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:51.423251 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:51.424458 18426 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:51.426194 17204 raft_consensus.cc:1240] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260201 08:59:51.426956 18426 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:51.420562 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:51.422341 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:51.405818 18381 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.430137 18381 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.432202 18381 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:51.424556 17209 raft_consensus.cc:1240] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:51.405560 17846 raft_consensus.cc:1275] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260201 08:59:51.445236 17845 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:51.446072 17843 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260201 08:59:51.449635 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:51.450392 17211 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:51.408476 18269 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:51.416836 18410 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.458640 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:51.463927 17284 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:51.411091 18167 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:51.451975 17846 pending_rounds.cc:85] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Aborting all ops after (but not including) 1
I20260201 08:59:51.402179 18334 consensus_queue.cc:1059] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260201 08:59:51.465096 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:51.436043 18317 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:51.471683 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:51.477898 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:51.478137 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:51.478543 17211 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:51.475320 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:51.480732 17793 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:51.484891 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:51.486049 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:51.477111 17278 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:51.478690 17848 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:51.468580 17846 pending_rounds.cc:107] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:51.454746 17840 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:51.411191 18336 consensus_queue.cc:237] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:51.480054 17285 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
W20260201 08:59:51.513409 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 46693.6us
I20260201 08:59:51.470432 18410 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.519281 18528 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.521515 17284 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:51.526558 17249 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:51.465371 18269 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.512450 17846 raft_consensus.cc:2889] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260201 08:59:51.606385 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 110572us
W20260201 08:59:51.614296 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 95735us
I20260201 08:59:51.513988 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:51.472467 18167 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:51.619560 17177 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:51.620572 17103 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:51.515707 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:51.530113 18334 raft_consensus.cc:3055] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:51.627192 17177 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:51.604948 18426 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.629596 18426 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:51.630559 18428 consensus_meta.cc:287] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.572s user 0.009s sys 0.000s
I20260201 08:59:51.630981 18428 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:51.631544 18426 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:51.634117 18539 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.634654 18536 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.635195 18536 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.535317 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:51.649048 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:51.649873 17211 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:51.662424 17134 raft_consensus.cc:1275] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:51.627298 18123 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:51.677255 17102 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:51.627542 18160 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:51.627966 18334 raft_consensus.cc:740] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:51.703398 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:51.707901 17211 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:51.652136 17276 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
W20260201 08:59:51.718876 18535 log.cc:927] Time spent T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
W20260201 08:59:51.719657 18524 log.cc:927] Time spent T a4fc35bc514f47bc8de1d20b274d3416 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.204s user 0.000s sys 0.000s
W20260201 08:59:51.720451 18529 log.cc:927] Time spent T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
I20260201 08:59:51.634629 18539 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:51.698623 18428 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:51.722210 18317 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:51.723562 18167 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:51.723922 18536 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:51.617914 18528 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.673730 18129 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:51.696995 18123 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:51.692822 18525 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:51.693521 18543 raft_consensus.cc:2804] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:51.704484 18441 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:51.660363 18271 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:51.832923 18334 consensus_queue.cc:260] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:51.844525 18334 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:51.848057 18271 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:51.829514 18272 consensus_meta.cc:287] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.506s user 0.008s sys 0.001s
I20260201 08:59:51.829484 18129 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:51.854480 18129 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:51.830020 18123 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:51.854777 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:51.855954 18441 raft_consensus.cc:697] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:51.856272 18410 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:51.830776 18543 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:51.829794 18525 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 08:59:51.863727 17249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:51.864550 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:51.883893 17211 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
W20260201 08:59:51.865090 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 380503us
I20260201 08:59:51.834002 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:51.850798 18274 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:51.891534 17283 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:51.886735 18441 consensus_queue.cc:237] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:51.892669 18548 consensus_queue.cc:1048] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:51.894531 18548 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:51.896070 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:51.896377 17175 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:51.897732 17843 raft_consensus.cc:2393] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:51.878980 18269 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:51.879941 18525 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:51.894984 18548 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:51.910243 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:51.895287 18274 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:51.920063 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:51.915357 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 238184us
I20260201 08:59:51.924257 17102 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:51.879359 18543 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:51.837078 17790 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:51.928051 17133 raft_consensus.cc:1275] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260201 08:59:51.929688 17133 pending_rounds.cc:85] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 1
I20260201 08:59:51.929937 17133 pending_rounds.cc:107] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260201 08:59:51.930160 17133 raft_consensus.cc:2889] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260201 08:59:51.923566 18422 consensus_meta.cc:287] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.611s user 0.011s sys 0.001s
I20260201 08:59:51.936345 17102 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:51.896600 18549 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:51.925637 18118 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:51.932013 18160 raft_consensus.cc:697] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:51.951831 17208 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 08:59:51.953189 17102 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:51.958793 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:51.959595 17211 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:51.961345 18160 consensus_queue.cc:237] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:51.963546 17128 raft_consensus.cc:1275] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 08:59:51.951328 18554 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:51.964810 18246 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:51.952646 18427 consensus_queue.cc:1059] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260201 08:59:51.936969 18272 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:51.930037 17277 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
W20260201 08:59:52.032974 17175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:51.947899 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.083732 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.101320 17210 raft_consensus.cc:2393] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
W20260201 08:59:52.098191 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 145089us
W20260201 08:59:52.181542 18541 log.cc:927] Time spent T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260201 08:59:52.182524 18520 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.183066 18520 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:51.959597 18274 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.185253 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.185940 17211 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:52.100782 18422 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:52.198693 17793 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:52.200066 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 501925us
W20260201 08:59:52.201162 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 62699.5us
I20260201 08:59:52.204329 17102 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:52.203449 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 283437us
I20260201 08:59:52.186542 18542 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:52.082404 18272 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:52.189366 18528 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.272552 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:51.956924 18549 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.279829 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.280537 17284 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
W20260201 08:59:52.268221 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 343734us
W20260201 08:59:52.136507 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 308317us
I20260201 08:59:52.208911 18167 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.200307 18271 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.212930 18520 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:52.271845 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:52.278493 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.270237 18537 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:52.211905 18554 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:52.302402 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.204341 18123 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.274596 18539 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:52.215474 18542 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:52.204468 18427 consensus_queue.cc:1059] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260201 08:59:52.338681 17282 raft_consensus.cc:2368] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4.
I20260201 08:59:52.330555 17279 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:52.267120 17793 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:52.340703 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.213274 18246 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260201 08:59:52.365206 18539 consensus_queue.cc:1059] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:52.366503 18539 raft_consensus.cc:3055] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:52.366881 18539 raft_consensus.cc:740] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:52.361415 18428 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.368243 18428 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.369117 18556 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:52.286515 18557 consensus_queue.cc:1048] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260201 08:59:52.370266 18428 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.376510 18123 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.377518 18563 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.378062 18563 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.380023 18563 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.381345 18316 consensus_queue.cc:1048] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:52.339732 18537 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:52.382130 18537 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:52.382339 18427 raft_consensus.cc:3055] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:52.382747 18427 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
W20260201 08:59:52.393252 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 126219us
I20260201 08:59:52.329596 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.343766 18554 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.362510 18542 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:52.442409 17282 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260201 08:59:52.426728 18334 consensus_meta.cc:287] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.581s user 0.001s sys 0.009s
I20260201 08:59:52.365118 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.425719 18279 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:52.366729 18549 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.451399 18277 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:52.475075 18277 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.481746 18523 consensus_queue.cc:1059] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 08:59:52.482918 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.483562 17207 raft_consensus.cc:2376] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4. Re-sending same reply.
I20260201 08:59:52.484032 17207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 624) took 1016 ms. Trace:
I20260201 08:59:52.484331 17207 rpcz_store.cc:276] 0201 08:59:51.467456 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.467608 (+ 152us) service_pool.cc:225] Handling call
0201 08:59:52.482763 (+1015155us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:52.483976 (+ 1213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3719552}
I20260201 08:59:52.485178 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:52.485764 17211 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:52.455029 17177 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:52.487995 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 248511us
I20260201 08:59:52.485788 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.489538 17209 raft_consensus.cc:2393] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
W20260201 08:59:52.491735 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 226090us
I20260201 08:59:52.448661 17840 raft_consensus.cc:2368] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 08:59:52.493446 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:52.490597 18279 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:52.442997 18520 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.449421 18554 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:52.383517 18427 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:52.508229 17175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:52.453058 18548 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:52.367736 18539 consensus_queue.cc:260] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.425290 18543 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:52.513098 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 209617us
I20260201 08:59:52.494077 18118 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:52.495862 18549 raft_consensus.cc:3055] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:52.439911 18525 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.522194 17211 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:52.528129 17177 leader_election.cc:400] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4.
I20260201 08:59:52.528553 17177 leader_election.cc:403] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260201 08:59:52.455207 18270 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:52.503623 18279 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:52.504379 18425 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:52.552433 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.553247 17282 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:52.507594 18334 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.556559 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.554313 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.504406 17205 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:52.615026 18525 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.546669 18549 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:52.616117 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:52.519834 18118 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:52.519577 18277 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:52.427852 18167 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.549371 18336 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:52.558331 18551 log.cc:927] Time spent T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.451s user 0.001s sys 0.000s
I20260201 08:59:52.551332 18528 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4.
I20260201 08:59:52.613014 18427 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:52.513936 18520 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:52.663841 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 322201us
I20260201 08:59:52.667904 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:52.623059 18570 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.656067 18118 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:52.670614 18536 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:52.671171 18536 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.673381 18536 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:52.653265 18539 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:52.651082 18272 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.649495 18425 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.576280 18334 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:52.662878 18277 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.555501 18270 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.669291 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.701370 17134 raft_consensus.cc:1240] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []
W20260201 08:59:52.679422 18362 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.799s user 0.012s sys 0.035s
I20260201 08:59:52.703889 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.706291 17284 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:52.707168 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.711190 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.713120 17847 raft_consensus.cc:1275] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:52.665053 18336 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:52.711377 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 160995us
W20260201 08:59:52.723481 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:52.689206 18272 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.724366 17174 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:52.709287 18362 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.826s user 0.012s sys 0.035s
W20260201 08:59:52.726351 18560 log.cc:927] Time spent T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.358s user 0.001s sys 0.000s
I20260201 08:59:52.726748 17208 raft_consensus.cc:1240] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260201 08:59:52.727279 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:52.660977 18549 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.728339 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.687569 18425 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:52.713047 17204 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 08:59:52.721730 17843 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:52.733116 17177 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:52.725710 18561 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:52.690279 18569 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:52.711628 17841 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:52.730278 18160 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.711864 18575 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:52.776292 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.735356 18351 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.702301 18277 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.729732 18270 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:52.730520 18563 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:52.771989 18274 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:52.748950 18422 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.817248 18422 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:52.818050 18531 log.cc:927] Time spent T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 1.191s user 0.010s sys 0.006s
I20260201 08:59:52.819342 18422 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.748534 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:52.820066 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 87026.7us
I20260201 08:59:52.790056 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.790014 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:52.682699 18570 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.798605 17249 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:52.749305 18272 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:52.806581 18584 consensus_queue.cc:1059] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:52.806638 18573 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.807287 18563 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:52.799347 18575 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.807156 18520 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.807492 18562 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:52.808485 18572 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:52.849815 18577 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:52.850350 18572 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.808676 18528 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:52.852325 18573 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.853032 18528 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:52.853427 18528 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:52.854736 18573 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:52.778395 18561 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.858986 18561 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.810258 18277 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.791875 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:52.811414 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:52.860179 17206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 623) took 1439 ms (client timeout 1824 ms). Trace:
W20260201 08:59:52.860512 17206 rpcz_store.cc:269] 0201 08:59:51.437021 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.437160 (+ 139us) service_pool.cc:225] Handling call
0201 08:59:52.811253 (+1374093us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:52.860101 (+ 48848us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11790208}
I20260201 08:59:52.812239 18117 consensus_queue.cc:1048] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260201 08:59:52.812995 18585 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:52.792695 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.800295 18351 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:52.864619 18351 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:52.791098 17203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 407) took 1369 ms. Trace:
I20260201 08:59:52.795436 18160 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:52.779366 17793 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:52.844269 17103 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:52.865644 18425 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.789793 18569 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.866660 18365 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:52.867161 18160 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:52.867594 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 88243.8us
I20260201 08:59:52.867873 18569 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:52.868290 18167 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.870743 17129 raft_consensus.cc:1275] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:52.871232 17131 raft_consensus.cc:2393] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:52.828971 17276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36914 (request call id 114) took 1378 ms. Trace:
I20260201 08:59:52.871902 17276 rpcz_store.cc:276] 0201 08:59:51.443477 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.458198 (+ 14721us) service_pool.cc:225] Handling call
0201 08:59:52.808756 (+1350558us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b540047fed4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:52.822000 (+ 13244us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":44450560}
I20260201 08:59:52.867193 18365 raft_consensus.cc:697] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:52.873931 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.876624 18594 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:52.877163 18594 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:52.878497 18570 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:52.879163 18594 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:52.879928 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.880609 17844 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:52.805188 17132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 590) took 1610 ms. Trace:
I20260201 08:59:52.881767 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.822942 18543 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.820922 18334 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.881469 17211 raft_consensus.cc:1240] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:52.883765 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:52.850394 18577 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:52.884363 17843 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:52.885221 18272 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.852632 18572 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:52.886050 18571 log.cc:927] Time spent T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.204s user 0.000s sys 0.001s
I20260201 08:59:52.865159 17203 rpcz_store.cc:276] 0201 08:59:51.409809 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.411071 (+ 1262us) service_pool.cc:225] Handling call
0201 08:59:51.476193 (+ 65122us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:51.677532 (+201339us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:51.696575 (+ 19043us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:51.830580 (+134005us) log.cc:844] Serialized 26 byte log entry
0201 08:59:52.197215 (+366635us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:52.205242 (+ 8027us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:52.210279 (+ 5037us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:52.750699 (+540420us) raft_consensus.cc:1685] finished
0201 08:59:52.750732 (+ 33us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:52.778848 (+ 28116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7005,"raft.queue_time_us":126812,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":9025,"thread_start_us":409856,"threads_started":2,"wal-append.queue_time_us":654437}
I20260201 08:59:52.881855 17132 rpcz_store.cc:276] 0201 08:59:51.192126 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.197293 (+ 5167us) service_pool.cc:225] Handling call
0201 08:59:51.269034 (+ 71741us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:51.367783 (+ 98749us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:51.372202 (+ 4419us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:51.442152 (+ 69950us) log.cc:844] Serialized 26 byte log entry
0201 08:59:51.802080 (+359928us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:51.871009 (+ 68929us) log.cc:844] Serialized 14 byte log entry
0201 08:59:51.882552 (+ 11543us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:51.888321 (+ 5769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:52.793123 (+904802us) raft_consensus.cc:1685] finished
0201 08:59:52.793143 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:52.802803 (+ 9660us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38355,"prepare.queue_time_us":14550,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":30401,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":10420,"thread_start_us":216566,"threads_started":1,"wal-append.queue_time_us":463001}
I20260201 08:59:52.819381 18118 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.891867 18118 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:52.855947 18579 log.cc:927] Time spent T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260201 08:59:52.892550 17208 raft_consensus.cc:1240] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:52.892387 18528 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.894197 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.807350 18274 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:52.894476 18528 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.896652 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.895965 18274 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:52.898463 18336 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.898379 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.899137 17843 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:52.900195 17175 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:52.900209 18575 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:52.901371 18413 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:52.901849 18413 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:52.902686 17175 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:52.904354 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:52.904417 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 166704us
I20260201 08:59:52.908290 17845 raft_consensus.cc:2393] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
W20260201 08:59:52.908344 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 64178.9us
I20260201 08:59:52.884821 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.911201 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.917455 17845 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 1.
I20260201 08:59:52.918459 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:52.919067 17845 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:52.902176 18413 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:52.920594 17249 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:52.886219 18577 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:52.926643 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.901384 18563 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:52.933607 17250 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:52.933635 17847 raft_consensus.cc:2393] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:52.916702 18425 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260201 08:59:52.909333 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 478186us
I20260201 08:59:52.948093 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.929401 18525 raft_consensus.cc:2804] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:52.931845 18573 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.955155 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:52.955982 17174 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:52.952406 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:52.942826 18537 consensus_meta.cc:287] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.560s user 0.009s sys 0.001s
I20260201 08:59:52.957316 17845 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:52.984225 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.959115 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:52.960088 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:52.982353 17134 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:52.921568 18539 consensus_queue.cc:1059] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260201 08:59:52.988986 17175 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:52.957851 17102 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.194.67:33911 timed out after 1.824s (SENT) [suppressed 11 similar messages]
I20260201 08:59:52.942350 18558 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.896229 18562 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:52.902495 18542 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:52.953576 18132 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.998874 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:53.001658 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.958333 18269 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:52.951588 18585 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.958081 18556 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:52.950083 18425 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:52.900216 18365 consensus_queue.cc:237] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.008419 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:52.981819 18427 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:53.002938 17790 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:52.992130 18163 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:52.995983 17839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39018 (request call id 526) took 1719 ms. Trace:
I20260201 08:59:52.991956 18525 raft_consensus.cc:697] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:53.020789 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:52.999974 18540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s user 0.033s sys 0.019s
I20260201 08:59:53.012116 18501 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:52.995607 18450 consensus_queue.cc:1048] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260201 08:59:53.021446 18425 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:53.014585 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.014017 18274 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.017905 18269 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 08:59:53.038550 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 80737.6us
I20260201 08:59:52.992210 18537 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.023706 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:53.023200 18589 raft_consensus.cc:3055] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:53.032730 18539 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:53.024922 18598 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:53.041437 18566 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:53.023844 18556 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:53.045620 18595 log.cc:927] Time spent T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20260201 08:59:53.048060 18525 consensus_queue.cc:237] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.022992 18585 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:53.028210 18406 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:53.026811 18427 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:53.050271 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 60149.1us
I20260201 08:59:53.041255 18552 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:53.052805 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.054013 18562 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.054705 17248 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:53.055473 17250 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.158383 17284 raft_consensus.cc:3060] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.056921 18279 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.057271 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.159103 17285 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.002748 18573 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.170825 18279 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.077178 18160 consensus_queue.cc:1059] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260201 08:59:53.058782 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 08:59:53.059513 18554 consensus_meta.cc:287] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.547s user 0.009s sys 0.000s
I20260201 08:59:53.016785 18132 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.008585 18558 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:53.038933 18501 raft_consensus.cc:697] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:53.125136 18163 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:53.063091 18592 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:53.027105 17839 rpcz_store.cc:276] 0201 08:59:51.273670 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.289351 (+ 15681us) service_pool.cc:225] Handling call
0201 08:59:52.477337 (+1187986us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:52.477564 (+ 227us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:52.477795 (+ 231us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 08:59:52.731333 (+253538us) log.cc:844] Serialized 14 byte log entry
0201 08:59:52.929805 (+198472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:52.937209 (+ 7404us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:52.948717 (+ 11508us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:52.958886 (+ 10169us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:52.992977 (+ 34091us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":300355,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":74,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":11072,"spinlock_wait_cycles":6169984,"thread_start_us":350218,"threads_started":2,"wal-append.queue_time_us":277684}
I20260201 08:59:53.052927 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.075685 17102 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.073391 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.052726 18542 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.080391 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.070641 18317 raft_consensus.cc:3055] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
W20260201 08:59:53.068269 18540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s user 0.034s sys 0.019s
I20260201 08:59:53.074934 18269 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.120344 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.121081 17846 raft_consensus.cc:2393] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:53.121377 18406 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:53.111300 17276 raft_consensus.cc:2410] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260201 08:59:53.056543 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:53.176455 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 121057us
I20260201 08:59:53.187160 17285 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:53.177459 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:53.179894 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 104287us
I20260201 08:59:53.179714 17133 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:53.178891 17284 raft_consensus.cc:2468] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:53.079160 18589 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:53.074688 18274 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.111817 18566 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.192819 17207 raft_consensus.cc:2368] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 08:59:53.075182 18425 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.119639 18598 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.167213 18552 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.174398 18544 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 08:59:53.176103 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 121464us
I20260201 08:59:53.172832 18554 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:53.173597 18351 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.198977 18351 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.199262 18554 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.199918 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.194221 18117 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.200325 18406 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.179376 18427 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.200661 18117 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.178139 18163 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:53.194936 18566 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.202593 18117 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.203308 18163 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.177927 18501 consensus_queue.cc:237] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.206043 18585 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.206461 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.188788 17102 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.194617 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.200845 18351 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.210426 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.209471 17102 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.194550 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.207116 17130 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:53.180208 18562 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:53.177692 18548 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:53.219746 18548 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.220109 18548 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.200508 17276 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.212041 17284 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:53.178489 18547 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:53.174244 18132 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.180687 18317 raft_consensus.cc:740] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:53.216948 17177 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:53.175446 18556 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.175671 18558 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.218001 18554 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:53.219355 17250 leader_election.cc:400] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 08:59:53.201514 17137 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:53.229748 17250 leader_election.cc:403] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260201 08:59:53.228055 17174 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:53.210640 18427 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.206480 18573 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:53.206768 18544 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.231680 17174 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:53.234881 18132 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:53.236277 18117 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:53.239105 18585 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:53.239619 18585 raft_consensus.cc:697] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:53.240428 18585 consensus_queue.cc:237] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.242156 18274 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.242200 18317 consensus_queue.cc:260] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.243348 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.236138 18425 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.244612 17177 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:53.237167 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.178714 18592 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.238780 18132 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.221238 18533 consensus_queue.cc:1059] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260201 08:59:53.246959 18521 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:53.247390 18537 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.243949 17203 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.244124 18317 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.220189 18589 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.268450 17790 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.259465 18132 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:53.259784 18413 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.259894 18428 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:53.278101 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.220621 18577 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.267853 18552 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.260798 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.274785 17174 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:53.277223 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.259769 18117 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 08:59:53.253659 18558 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:53.279048 17284 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:53.280903 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.290496 17209 raft_consensus.cc:2393] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:53.276453 18539 raft_consensus.cc:3055] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:53.271139 18521 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.294495 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:53.295121 17282 raft_consensus.cc:1240] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:53.296355 17276 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:53.296875 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.296927 17842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 438) took 1408 ms. Trace:
I20260201 08:59:53.302229 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:53.303560 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:53.304044 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.304344 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 08:59:53.304641 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.305685 17280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54622 (request call id 651) took 1040 ms. Trace:
I20260201 08:59:53.280517 18533 consensus_queue.cc:1048] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260201 08:59:53.307998 18548 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:53.308893 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.341362 17284 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:53.278432 18381 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.341943 17131 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:53.279881 18428 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.344774 17790 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.344547 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.285928 18520 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:53.346033 18520 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.346378 18549 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.294968 18577 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.326658 17103 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:53.347879 17103 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:53.348907 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.349232 17790 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.327440 18269 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.329759 18592 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.330078 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.330479 18413 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.330586 17130 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 08:59:53.331385 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.333230 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.332501 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:53.334911 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:53.358462 17848 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.344655 18598 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.327222 18566 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.339361 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.338737 17280 rpcz_store.cc:276] 0201 08:59:52.265281 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:52.269596 (+ 4315us) service_pool.cc:225] Handling call
0201 08:59:53.304983 (+1035387us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f12e 000000000035a3c9 00007f74b5179560 00007f74b5241dd4 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:53.305165 (+ 182us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:53.305346 (+ 181us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:53.305372 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:53.305432 (+ 60us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:53.305462 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:53.305528 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:53.305631 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7734528}
I20260201 08:59:53.301035 18539 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:53.369104 18539 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.370235 18539 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:53.374715 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 1.04499e+06us
W20260201 08:59:53.382922 18559 log.cc:927] Time spent T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 1.009s user 0.000s sys 0.004s
I20260201 08:59:53.385350 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.386075 17135 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:53.386621 18520 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.386967 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.389241 18269 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.391541 17285 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.392390 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:53.393072 17202 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:53.396613 17174 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:53.346387 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.344928 18428 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:53.277482 18537 consensus_queue.cc:1048] T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260201 08:59:53.337298 17177 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:53.404840 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 67619.9us
I20260201 08:59:53.364570 18544 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.405869 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.406718 17279 raft_consensus.cc:2393] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:53.350135 18381 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:53.409039 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.409258 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.361115 18609 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:53.299800 18552 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:53.410213 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.398070 17844 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:53.411617 18609 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.411742 17175 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:53.412079 18609 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.412729 17136 raft_consensus.cc:2410] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 08:59:53.342327 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.418197 18566 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.420236 18592 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.420929 18413 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:53.420750 18592 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.421433 18413 raft_consensus.cc:697] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:53.404400 18525 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:53.422598 18592 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.422750 18521 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:53.397956 17102 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:53.397330 17794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:53.350939 18167 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.393935 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.401525 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.428422 17845 raft_consensus.cc:2368] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 08:59:53.428939 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.429220 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.352481 18327 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:53.322247 17842 rpcz_store.cc:276] 0201 08:59:51.888398 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.890353 (+ 1955us) service_pool.cc:225] Handling call
0201 08:59:53.295663 (+1405310us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f12e 000000000035a3c9 00007f74b5179560 00007f74b5241dd4 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:53.295828 (+ 165us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:53.296001 (+ 173us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:53.296027 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:53.296638 (+ 611us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:53.296679 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:53.296752 (+ 73us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:53.296874 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7303424}
I20260201 08:59:53.367707 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.410514 18552 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.430189 18327 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.430626 18552 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.431954 17249 leader_election.cc:400] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 08:59:53.432304 17249 leader_election.cc:403] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 08:59:53.424664 17102 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.410399 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.411768 18501 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:53.409417 18381 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:53.426600 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.424680 17128 raft_consensus.cc:2393] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:53.433112 17250 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.429039 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:53.424063 17248 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:53.409046 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.399803 17285 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:53.436596 17848 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:53.446627 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.440830 17284 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:53.448257 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:53.448549 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.449591 17206 raft_consensus.cc:2393] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:53.450204 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.451344 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.452030 17137 raft_consensus.cc:2393] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:53.452773 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.455093 17206 raft_consensus.cc:1275] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:53.430711 18327 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.422340 18525 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:53.464134 17250 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.479441 18117 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.473367 18185 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.480602 18525 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.481453 18132 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.482111 17129 raft_consensus.cc:3060] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.422297 18413 consensus_queue.cc:237] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.471551 17174 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:53.474403 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 50428.3us
I20260201 08:59:53.465289 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.491852 17284 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.482846 18406 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.483285 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.483501 18132 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.444021 18381 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.443648 18271 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:53.430127 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.443917 18163 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:53.445710 18317 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.445554 18316 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 08:59:53.491909 17175 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:53.492730 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.494649 17103 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:53.496156 17248 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:53.497996 17793 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.498842 18362 consensus_queue.cc:1048] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:53.499816 18501 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.484248 18577 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:53.482915 17131 raft_consensus.cc:1240] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:53.529585 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.452843 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.540089 17284 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:53.487936 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.513160 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.457937 17130 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:53.520924 17202 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.553660 17847 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 08:59:53.541982 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:53.525739 18262 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.543963 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.515488 18163 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.538143 18577 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 08:59:53.546152 17840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38998 (request call id 439) took 1649 ms (client timeout 1597 ms). Trace:
I20260201 08:59:53.547178 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.548383 17207 raft_consensus.cc:1275] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260201 08:59:53.549552 18611 log.cc:927] Time spent T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260201 08:59:53.549430 18327 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.552250 18410 consensus_queue.cc:1059] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:53.502475 18271 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.557078 17281 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:53.569404 17281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54622 (request call id 655) took 1292 ms. Trace:
I20260201 08:59:53.529397 18304 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.523010 18570 raft_consensus.cc:3055] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:53.564441 17177 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.571792 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.500941 18532 consensus_queue.cc:1059] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260201 08:59:53.498772 18406 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.530896 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.542191 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:53.523783 18528 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:53.519973 18427 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 08:59:53.567278 17790 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 08:59:53.538564 18608 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.077s user 0.000s sys 0.004s
I20260201 08:59:53.569694 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.573289 18270 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:53.559960 18163 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.574216 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.576149 17844 raft_consensus.cc:2393] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:53.583247 17207 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.583838 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.560623 18577 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.577852 18537 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:53.578658 17135 raft_consensus.cc:2393] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:53.571002 18271 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.569729 17281 rpcz_store.cc:276] 0201 08:59:52.277220 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:52.283811 (+ 6591us) service_pool.cc:225] Handling call
0201 08:59:53.543829 (+1260018us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:53.569344 (+ 25515us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9478400}
I20260201 08:59:53.560933 17131 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.568159 18548 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:53.587953 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.571521 18570 raft_consensus.cc:740] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:53.591913 18588 log.cc:927] Time spent T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.709s user 0.003s sys 0.000s
I20260201 08:59:53.585391 18427 raft_consensus.cc:697] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:53.568341 18381 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.599587 17177 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:53.568831 18521 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260201 08:59:53.585067 17130 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:53.587572 18537 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:53.615094 18537 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.615582 17177 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.616354 18501 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.580658 17128 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:53.620373 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.619107 17103 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.624719 18317 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.626323 18327 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.627282 17202 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:53.621629 17794 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:53.630862 18262 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.631479 17794 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:53.561426 17840 rpcz_store.cc:269] 0201 08:59:51.897052 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.920886 (+ 23834us) service_pool.cc:225] Handling call
0201 08:59:53.545945 (+1625059us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54001f6654. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:53.546084 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":612509952}
I20260201 08:59:53.632836 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.633242 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.633638 17840 raft_consensus.cc:2393] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:53.634438 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.634722 18410 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:53.635411 18539 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:53.635178 18577 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.636338 18406 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.638198 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.638779 17842 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:53.635118 18410 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.639283 18410 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.624773 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.641791 17129 raft_consensus.cc:1275] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:53.642769 17843 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:53.643990 17843 raft_consensus.cc:1275] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:53.646590 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.647761 17794 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.648342 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.648967 18536 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:53.650102 17794 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:53.651510 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45884 (request call id 419) took 1133 ms. Trace:
I20260201 08:59:53.651872 17204 rpcz_store.cc:276] 0201 08:59:52.518580 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:52.518683 (+ 103us) service_pool.cc:225] Handling call
0201 08:59:53.651357 (+1132674us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540017cfd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:53.651459 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":353002880}
I20260201 08:59:53.655206 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:53.622653 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.655920 17175 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:53.623137 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.650780 18539 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:53.628823 18381 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:53.610194 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.629894 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:53.657720 18539 raft_consensus.cc:697] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:53.661159 17844 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:53.660974 18539 consensus_queue.cc:237] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.658417 17206 raft_consensus.cc:2368] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 08:59:53.662616 18501 consensus_queue.cc:1048] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:53.663152 17793 leader_election.cc:400] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 08:59:53.663436 17793 leader_election.cc:403] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260201 08:59:53.664250 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.664494 18521 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:53.665912 17278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54622 (request call id 652) took 1400 ms. Trace:
I20260201 08:59:53.659386 18406 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:53.666713 18406 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.667064 18406 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.657279 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:53.666296 17278 rpcz_store.cc:276] 0201 08:59:52.265647 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:52.273572 (+ 7925us) service_pool.cc:225] Handling call
0201 08:59:53.656766 (+1383194us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b58003fb798. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:53.665446 (+ 8680us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:53.665605 (+ 159us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:53.665631 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:53.665668 (+ 37us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:53.665700 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:53.665751 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:53.665846 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7760128}
I20260201 08:59:53.668947 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.659682 18534 raft_consensus.cc:3055] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:53.671072 18534 raft_consensus.cc:740] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:53.671844 18534 consensus_queue.cc:260] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.672555 18117 raft_consensus.cc:3055] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:53.661811 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.673663 17278 raft_consensus.cc:1275] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:53.597622 18609 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.672984 18117 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:53.655369 17846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39002 (request call id 511) took 1457 ms. Trace:
I20260201 08:59:53.621979 17249 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.621501 17207 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 08:59:53.651298 18304 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260201 08:59:53.682003 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 59653.1us
I20260201 08:59:53.677853 17793 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:53.684155 17281 raft_consensus.cc:2368] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:53.685250 17794 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.681891 17280 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:53.585537 18528 raft_consensus.cc:697] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:53.697060 17280 raft_consensus.cc:1240] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:53.698240 17794 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.686110 17250 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:53.709422 17278 raft_consensus.cc:1240] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:53.677022 18270 raft_consensus.cc:2764] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260201 08:59:53.732933 18570 consensus_queue.cc:260] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.690728 17203 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:53.676064 17131 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 08:59:53.691879 18167 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:53.732813 17279 raft_consensus.cc:1240] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:53.747713 17131 raft_consensus.cc:1240] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:53.690330 18428 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:53.733820 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:53.677407 18279 consensus_queue.cc:1048] T 2b8fb1d921544e74ad028b4471690420 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260201 08:59:53.736214 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:53.749826 17136 raft_consensus.cc:2393] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:53.728947 18525 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.736955 17277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 120) took 1534 ms. Trace:
I20260201 08:59:53.696028 18163 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.728436 18609 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:53.744343 18117 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:53.745222 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 56317.5us
W20260201 08:59:53.753028 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 134292us
I20260201 08:59:53.754648 17174 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:53.762126 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.765467 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.746688 18570 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.716346 17101 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.680006 17132 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:53.775427 17281 raft_consensus.cc:1275] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 08:59:53.777905 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 61645.8us
I20260201 08:59:53.690856 18534 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.766724 17248 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:53.757457 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 44236.3us
I20260201 08:59:53.784024 17101 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.761359 18567 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:53.700752 18262 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:53.734813 18589 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.742357 18577 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.786005 17101 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.740825 18410 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.808789 18521 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 08:59:53.821398 17248 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:53.822530 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.823458 17280 raft_consensus.cc:2393] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:53.814347 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.810865 17101 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.815313 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.752321 18525 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.711732 18558 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:53.788489 18117 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.738345 18537 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:53.791134 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:53.791873 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.743295 18523 consensus_queue.cc:1059] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260201 08:59:53.793437 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:53.794561 18428 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:53.795291 18422 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:53.795816 18545 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:53.796250 18546 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:53.751214 17277 rpcz_store.cc:276] 0201 08:59:52.202971 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:52.204188 (+ 1217us) service_pool.cc:225] Handling call
0201 08:59:52.341097 (+136909us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:52.452548 (+111451us) raft_consensus.cc:1534] Early marking committed up to index 1
0201 08:59:52.458452 (+ 5904us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:52.616627 (+158175us) log.cc:844] Serialized 26 byte log entry
0201 08:59:52.792505 (+175878us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:52.795962 (+ 3457us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:52.799483 (+ 3521us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:53.591387 (+791904us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 08:59:53.736606 (+145219us) raft_consensus.cc:1685] finished
0201 08:59:53.736635 (+ 29us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:53.736894 (+ 259us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20909,"raft.queue_time_us":21344,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4187,"spinlock_wait_cycles":31243008,"thread_start_us":104977,"threads_started":1,"wal-append.queue_time_us":223829}
I20260201 08:59:53.798417 17136 raft_consensus.cc:1240] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:53.802629 17281 raft_consensus.cc:1275] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 08:59:53.806389 18316 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:53.802742 17103 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.907255 17848 raft_consensus.cc:1275] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260201 08:59:53.908130 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 105469us
I20260201 08:59:53.808678 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.828706 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:53.829561 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 143533us
I20260201 08:59:53.695783 18381 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:53.828917 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.913601 17278 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:53.791657 18163 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.744124 18271 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.842731 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.822644 18566 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.926580 17177 leader_election.cc:400] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:53.927098 17177 leader_election.cc:403] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:53.898026 17131 raft_consensus.cc:1240] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:53.683933 17846 rpcz_store.cc:276] 0201 08:59:52.197847 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:52.201882 (+ 4035us) service_pool.cc:225] Handling call
0201 08:59:53.655187 (+1453305us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b54001f7554. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:53.655314 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1568447872}
I20260201 08:59:53.690573 18552 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.892616 16957 catalog_manager.cc:5654] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 2 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 08:59:53.939286 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:53.939204 16957 catalog_manager.cc:5654] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:53.781858 18609 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:53.824126 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:53.902516 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:53.977584 17210 raft_consensus.cc:1240] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:53.815274 18410 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:53.742666 18427 consensus_queue.cc:237] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:53.915711 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 87063us
I20260201 08:59:53.919616 18362 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:53.928964 17177 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.890475 17284 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:53.920974 18592 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260201 08:59:53.846963 18558 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:53.835248 18598 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:53.955422 17280 raft_consensus.cc:1275] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:53.926656 18425 consensus_queue.cc:1048] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260201 08:59:53.912845 18316 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:53.937438 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:53.988320 17136 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:53.947669 16957 catalog_manager.cc:5654] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:53.989943 16957 catalog_manager.cc:5654] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:53.926687 18546 raft_consensus.cc:697] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:53.920593 17130 raft_consensus.cc:606] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:53.931198 18186 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:53.937364 17839 raft_consensus.cc:1240] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:53.905931 17276 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:53.979709 17844 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.981148 17101 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:53.982103 16958 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34906 (request call id 59) took 3088 ms. Trace:
I20260201 08:59:53.935817 17248 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:53.985577 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 56694.1us
I20260201 08:59:54.003758 17101 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.986161 17132 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.983372 18362 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:53.899214 18528 consensus_queue.cc:237] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:53.955245 18381 raft_consensus.cc:697] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:53.991971 18316 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:53.992506 18317 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:53.996403 18406 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.005116 17101 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:53.976595 17840 raft_consensus.cc:2393] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:53.986004 18525 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:53.987551 18598 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:53.980654 18539 consensus_queue.cc:1048] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260201 08:59:53.993940 16957 catalog_manager.cc:5654] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 2 to 3, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
W20260201 08:59:54.025465 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 89754.3us
I20260201 08:59:54.026249 17284 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:53.999938 17130 raft_consensus.cc:614] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:54.032024 17136 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 08:59:54.042706 16957 catalog_manager.cc:5654] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 3, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:54.046741 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:54.012643 18422 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:54.017079 18362 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:54.047705 17174 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:54.013208 18609 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:54.033454 18189 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:54.049304 16957 catalog_manager.cc:5654] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 2, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 08:59:54.052675 17135 raft_consensus.cc:2368] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:54.043951 17103 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:54.037864 18598 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:54.012730 18118 consensus_queue.cc:1048] T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260201 08:59:54.030587 18572 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:54.013523 18132 consensus_queue.cc:1059] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260201 08:59:54.065071 16957 catalog_manager.cc:5654] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 08:59:54.020066 18501 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260201 08:59:54.051443 17277 raft_consensus.cc:1275] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:54.096670 17174 leader_election.cc:400] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:54.097102 17174 leader_election.cc:403] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 08:59:54.075968 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:54.080312 18619 log.cc:927] Time spent T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.103s user 0.000s sys 0.001s
I20260201 08:59:54.076615 18609 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:54.081849 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:54.069106 18525 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:54.089120 17136 raft_consensus.cc:2393] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:54.090091 16957 catalog_manager.cc:5654] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 3 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 08:59:54.030159 18317 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.037613 18410 consensus_queue.cc:1059] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260201 08:59:54.097982 17206 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
W20260201 08:59:54.073022 18622 log.cc:927] Time spent T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.067s user 0.001s sys 0.000s
W20260201 08:59:54.076921 18620 log.cc:927] Time spent T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.233s user 0.000s sys 0.001s
I20260201 08:59:54.070616 18189 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:54.132380 18189 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:54.132917 18279 consensus_queue.cc:1059] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260201 08:59:54.133785 18279 raft_consensus.cc:3055] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:54.134141 18279 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:54.134860 18279 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.135177 18269 consensus_queue.cc:1059] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:54.136147 18585 raft_consensus.cc:3055] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:54.136536 18585 raft_consensus.cc:740] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:54.137776 18585 consensus_queue.cc:260] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:54.139076 18585 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:54.141765 18525 raft_consensus.cc:697] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:54.142692 18525 consensus_queue.cc:237] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:54.063674 18546 consensus_queue.cc:237] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:54.147953 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:54.148801 17131 raft_consensus.cc:2393] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:54.117734 18381 consensus_queue.cc:237] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:54.113510 18618 log.cc:927] Time spent T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.083s user 0.001s sys 0.000s
I20260201 08:59:54.136221 18269 raft_consensus.cc:3055] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:54.155939 18269 raft_consensus.cc:740] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:54.156807 18269 consensus_queue.cc:260] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:54.157701 18558 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:54.158507 18269 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:54.114703 16957 catalog_manager.cc:5654] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 3, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:54.165558 16957 catalog_manager.cc:5654] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 08:59:54.078122 18271 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:54.129177 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:54.125933 18406 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:54.135975 18279 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:54.003116 16958 rpcz_store.cc:276] 0201 08:59:50.868244 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:50.868544 (+ 300us) service_pool.cc:225] Handling call
0201 08:59:53.942966 (+3074422us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 08:59:51.714139 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 08:59:51.957165 (+243026us) write_op.cc:432] Acquiring schema lock in shared mode
0201 08:59:52.065441 (+108276us) write_op.cc:435] Acquired schema lock
0201 08:59:52.106425 (+ 40984us) tablet.cc:660] Decoding operations
0201 08:59:52.365917 (+259492us) write_op.cc:620] Acquiring the partition lock for write op
0201 08:59:52.366005 (+ 88us) write_op.cc:641] Partition lock acquired for write op
0201 08:59:52.366035 (+ 30us) tablet.cc:683] Acquiring locks for 16 operations
0201 08:59:52.367293 (+ 1258us) tablet.cc:699] Row locks acquired
0201 08:59:52.367325 (+ 32us) write_op.cc:260] PREPARE: finished
0201 08:59:52.367478 (+ 153us) write_op.cc:270] Start()
0201 08:59:52.367630 (+ 152us) write_op.cc:276] Timestamp: P: 1769936392367422 usec, L: 0
0201 08:59:52.367664 (+ 34us) op_driver.cc:348] REPLICATION: starting
0201 08:59:52.368418 (+ 754us) log.cc:844] Serialized 6361 byte log entry
0201 08:59:52.858107 (+489689us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74ad16ef0c 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab
0201 08:59:53.244680 (+386573us) op_driver.cc:464] REPLICATION: finished
0201 08:59:53.336056 (+ 91376us) write_op.cc:301] APPLY: starting
0201 08:59:53.336156 (+ 100us) tablet.cc:1365] starting BulkCheckPresence
0201 08:59:53.399286 (+ 63130us) tablet.cc:1368] finished BulkCheckPresence
0201 08:59:53.408298 (+ 9012us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 08:59:53.594065 (+185767us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 08:59:53.594371 (+ 306us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0201 08:59:53.594427 (+ 56us) write_op.cc:312] APPLY: finished
0201 08:59:53.594788 (+ 361us) log.cc:844] Serialized 112 byte log entry
0201 08:59:53.594985 (+ 197us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:53.595155 (+ 170us) write_op.cc:454] Released schema lock
0201 08:59:53.595223 (+ 68us) write_op.cc:341] FINISH: Updating metrics
0201 08:59:53.595607 (+ 384us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:53.595633 (+ 26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":60639,"apply.run_cpu_time_us":5884,"apply.run_wall_time_us":259573,"num_ops":16,"prepare.queue_time_us":202952,"prepare.run_cpu_time_us":70782,"prepare.run_wall_time_us":1553881,"raft.queue_time_us":144965,"raft.run_cpu_time_us":5681,"raft.run_wall_time_us":70124,"replication_time_us":854837,"spinlock_wait_cycles":90675456,"thread_start_us":924892,"threads_started":4,"wal-append.queue_time_us":680623}]]}
I20260201 08:59:54.173906 17206 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:54.190618 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:54.191274 17210 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:54.193125 17102 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:54.116717 18562 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:54.169286 18566 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:54.195374 17102 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:54.208001 18422 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:54.208392 18422 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:54.208737 18422 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:54.209940 18262 raft_consensus.cc:3055] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:54.195065 18426 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260201 08:59:54.186905 18413 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:54.211598 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:54.182636 18610 log.cc:927] Time spent T 6af74496ca1949d78f5a2a08f5cb9635 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20260201 08:59:54.200445 18609 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:54.212961 18609 raft_consensus.cc:697] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:54.213791 18609 consensus_queue.cc:237] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.225600 17841 raft_consensus.cc:1275] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260201 08:59:54.226058 17841 pending_rounds.cc:85] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Aborting all ops after (but not including) 3
I20260201 08:59:54.226256 17841 pending_rounds.cc:107] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260201 08:59:54.226452 17841 raft_consensus.cc:2889] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:54.227072 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:54.208452 17128 consensus_meta.cc:287] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.518s user 0.006s sys 0.001s
I20260201 08:59:54.227775 17843 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:54.235122 17278 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:54.177521 18362 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:54.184674 18317 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:54.192075 18537 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:54.195858 18552 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:54.210330 18262 raft_consensus.cc:740] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:54.238276 17794 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:54.239566 17175 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:54.240576 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:54.258844 17136 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:54.269125 18536 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:54.271340 18189 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:54.272639 18422 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.274641 18422 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:54.237393 17128 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 08:59:54.283771 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:54.286006 18362 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:54.264509 18501 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:54.287091 18501 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:54.287474 18501 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:54.276443 17132 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:54.280177 18598 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:54.292224 17174 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:54.276270 18262 consensus_queue.cc:260] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:54.304167 17174 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:54.257659 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:54.310612 17282 raft_consensus.cc:1275] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:54.312225 18537 consensus_queue.cc:1048] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:54.308884 17131 raft_consensus.cc:2393] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:54.318706 17133 raft_consensus.cc:1240] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:54.302598 18327 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:54.305944 18413 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:54.315608 18362 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:54.315819 18570 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:54.358202 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:54.357126 17840 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260201 08:59:54.367223 18536 raft_consensus.cc:697] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:54.359304 18189 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:54.377302 18536 consensus_queue.cc:237] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:54.364735 18570 raft_consensus.cc:697] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:54.386593 17134 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 602) took 1314 ms. Trace:
I20260201 08:59:54.387020 17134 rpcz_store.cc:276] 0201 08:59:53.072028 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:53.072130 (+ 102us) service_pool.cc:225] Handling call
0201 08:59:53.678025 (+605895us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:53.775299 (+ 97274us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:53.775504 (+ 205us) raft_consensus.cc:1534] Early marking committed up to index 2
0201 08:59:54.008403 (+232899us) log.cc:844] Serialized 14 byte log entry
0201 08:59:54.109504 (+101101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:54.116306 (+ 6802us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:54.116353 (+ 47us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:54.116421 (+ 68us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:54.350412 (+233991us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b180029b840. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad15a2d6 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34
0201 08:59:54.386446 (+ 36034us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b540036e050. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:54.386542 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":79497,"prepare.queue_time_us":330912,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":214,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":83,"spinlock_wait_cycles":230759936,"thread_start_us":303945,"threads_started":2,"wal-append.queue_time_us":257818}
I20260201 08:59:54.393538 18428 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:54.366534 17203 raft_consensus.cc:1275] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:54.397483 17279 raft_consensus.cc:1240] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:54.398867 17844 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:54.354772 18362 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.401710 18167 consensus_queue.cc:1048] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 08:59:54.379294 17840 pending_rounds.cc:85] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Aborting all ops after (but not including) 2
I20260201 08:59:54.403026 17840 pending_rounds.cc:107] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260201 08:59:54.403271 17840 raft_consensus.cc:2889] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:54.403373 18167 consensus_queue.cc:1059] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:54.404505 18167 raft_consensus.cc:3055] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:54.392293 18316 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:54.401726 18362 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:54.407281 18167 raft_consensus.cc:740] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:54.410086 17278 raft_consensus.cc:1240] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:54.362766 18413 raft_consensus.cc:697] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:54.415609 17281 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
W20260201 08:59:54.416183 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:54.444658 18167 consensus_queue.cc:260] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:54.462471 17279 raft_consensus.cc:1240] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:54.455792 18570 consensus_queue.cc:237] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.422614 18163 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260201 08:59:54.501788 18598 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:54.419341 18381 consensus_queue.cc:1059] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260201 08:59:54.458289 18413 consensus_queue.cc:237] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:54.503690 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 08:59:54.507100 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 64666.1us
I20260201 08:59:54.427376 18501 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:54.645100 17790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:54.660975 17794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:54.575103 18635 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.157s user 0.001s sys 0.000s
I20260201 08:59:54.666973 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 08:59:54.671806 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:54.667685 18167 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:54.681775 17206 raft_consensus.cc:1275] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:54.665675 17202 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:54.669307 18316 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:54.576668 18349 consensus_queue.cc:1059] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.097s
I20260201 08:59:54.696833 18539 consensus_queue.cc:1048] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 08:59:54.697603 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 08:59:54.691192 18640 log.cc:927] Time spent T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.111s user 0.000s sys 0.001s
I20260201 08:59:54.710438 17280 raft_consensus.cc:1275] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 08:59:54.719094 18639 log.cc:927] Time spent T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260201 08:59:54.745402 17839 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:54.750289 18536 consensus_queue.cc:1048] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:54.810042 17281 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 08:59:54.792764 17846 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:54.804342 18501 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:54.835212 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 160065us
W20260201 08:59:54.865494 18644 log.cc:927] Time spent T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.072s user 0.000s sys 0.001s
I20260201 08:59:54.881091 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:54.856403 18349 raft_consensus.cc:3055] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:54.925774 17282 raft_consensus.cc:1275] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260201 08:59:54.921537 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 70254.1us
I20260201 08:59:54.940790 17175 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:54.884690 18349 raft_consensus.cc:740] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:54.937041 18381 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:54.952105 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:54.946769 18528 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:54.969599 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 584560us
I20260201 08:59:54.956390 18381 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:54.962733 17840 raft_consensus.cc:1275] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260201 08:59:54.975993 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 309077us
I20260201 08:59:54.975827 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:54.975440 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 46212.6us
I20260201 08:59:55.004992 17847 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:55.010403 17248 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 08:59:54.978097 18632 log.cc:927] Time spent T e6a0a5248f484893bbcb06eba6d364c7 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.709s user 0.005s sys 0.007s
I20260201 08:59:54.976194 18425 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:54.977155 18381 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:55.085786 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 66472.8us
I20260201 08:59:54.989236 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:54.969048 18528 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.005308 18666 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:54.961445 18349 consensus_queue.cc:260] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:55.110963 17790 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:55.088133 18425 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 08:59:55.117115 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 151012us
I20260201 08:59:55.118124 17211 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
W20260201 08:59:55.119597 17794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:55.105871 17130 raft_consensus.cc:1275] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260201 08:59:55.089675 18426 consensus_queue.cc:1048] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260201 08:59:55.130821 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.040024 18675 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:55.118209 18425 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:55.125113 17129 raft_consensus.cc:2393] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:55.129369 18362 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:55.142828 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 134968us
I20260201 08:59:55.113559 18666 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:55.122646 18552 consensus_queue.cc:1175] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3dee892ea94d4f2a92316ad6f79edca2" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 3 index: 2 } }
W20260201 08:59:55.405484 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 307788us
I20260201 08:59:55.131557 17276 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
W20260201 08:59:55.419934 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 296168us
I20260201 08:59:55.145222 18349 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:55.404614 18574 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260201 08:59:55.405923 18189 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:55.405441 17202 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
W20260201 08:59:55.510802 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 379954us
I20260201 08:59:55.415285 18327 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:55.415151 18381 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:55.157418 18186 consensus_queue.cc:1048] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.315s
I20260201 08:59:55.414129 18677 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:55.414219 18670 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.511220 18527 raft_consensus.cc:2764] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260201 08:59:55.415172 18362 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:55.417249 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 401345us
I20260201 08:59:55.530522 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 651) took 1219 ms. Trace:
I20260201 08:59:55.502316 18189 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:55.548305 18673 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.530324 18327 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.553838 18686 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:55.547552 18381 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.562667 18528 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.551445 18677 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.587953 18598 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:55.588689 18690 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.588539 18598 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.589179 18677 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.589877 18693 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.576455 18673 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.559696 17202 rpcz_store.cc:276] 0201 08:59:54.297854 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:54.299981 (+ 2127us) service_pool.cc:225] Handling call
0201 08:59:54.503518 (+203537us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:55.516797 (+1013279us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4950272}
I20260201 08:59:55.622606 17175 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:55.591137 18528 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:55.612057 18671 log.cc:927] Time spent T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.456s user 0.001s sys 0.000s
I20260201 08:59:55.552032 18670 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:55.609936 18666 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.591459 18598 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:55.630283 17794 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:55.581836 18686 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.590387 18693 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.589228 18690 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 08:59:55.647675 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 49871us
I20260201 08:59:55.633719 18691 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.640736 18271 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.650277 18271 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.633996 18679 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.627044 18528 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:55.656001 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.648092 18327 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.660387 18327 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.651051 18689 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.665073 18189 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.658953 18679 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.665103 18539 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.664924 18362 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.662621 18327 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:55.667470 18701 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.654031 18691 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:55.668722 18695 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:55.666985 18689 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.681046 17848 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 08:59:55.684147 18699 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.684772 18699 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:55.685914 18654 log.cc:927] Time spent T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.995s user 0.009s sys 0.021s
I20260201 08:59:55.687146 17841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 563) took 1291 ms. Trace:
W20260201 08:59:55.688185 17281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54622 (request call id 677) took 1753 ms (client timeout 1683 ms). Trace:
I20260201 08:59:55.687503 17841 rpcz_store.cc:276] 0201 08:59:54.395477 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:54.398643 (+ 3166us) service_pool.cc:225] Handling call
0201 08:59:54.398987 (+ 344us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:54.399312 (+ 325us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:54.399339 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:54.399779 (+ 440us) log.cc:844] Serialized 26 byte log entry
0201 08:59:54.436705 (+ 36926us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:54.436749 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:54.436818 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:55.685346 (+1248528us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 08:59:55.686841 (+ 1495us) raft_consensus.cc:1685] finished
0201 08:59:55.686870 (+ 29us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:55.687083 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3897,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":27080064,"thread_start_us":36636,"threads_started":1,"wal-append.queue_time_us":268408}
I20260201 08:59:55.689209 18362 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.689795 18362 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:55.690135 17279 raft_consensus.cc:1275] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260201 08:59:55.691273 18699 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.691879 18699 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.684244 18167 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.693641 18167 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.695634 18167 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.696475 18598 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.697062 18598 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:55.699034 18598 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.699107 17203 raft_consensus.cc:1275] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:55.700836 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:55.701169 18695 raft_consensus.cc:697] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:55.701557 17842 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:55.702389 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.703140 18362 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.692370 18699 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:55.705464 18700 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.705922 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.705991 18700 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:55.706761 17203 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:55.710032 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.709964 18695 consensus_queue.cc:237] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.712350 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.712800 18117 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.724416 18574 consensus_queue.cc:1243] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer 3dee892ea94d4f2a92316ad6f79edca2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260201 08:59:55.724340 18117 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:55.688632 17281 rpcz_store.cc:269] 0201 08:59:53.934452 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:53.939029 (+ 4577us) service_pool.cc:225] Handling call
0201 08:59:55.687979 (+1748950us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540029aed4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:55.688114 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1093876608}
I20260201 08:59:55.726007 18574 raft_consensus.cc:3055] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:55.726297 18117 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.726468 18574 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:55.726789 17277 raft_consensus.cc:1275] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 08:59:55.713018 18675 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.727751 18675 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:55.728585 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 217078us
I20260201 08:59:55.729220 18670 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.729548 17248 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:55.729753 18675 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.713536 17794 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:55.733186 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:55.733510 18589 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:55.733747 17843 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:55.735805 17790 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:55.726125 18262 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:55.737223 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:55.737519 18167 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:55.737807 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:55.740551 18589 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:55.743692 18589 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:55.745445 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 141) took 1629 ms. Trace:
I20260201 08:59:55.746227 18422 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.746565 18362 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.746847 18422 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.748181 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:55.748756 18422 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.746454 18562 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.751884 18562 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.727345 18574 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.716719 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:55.761144 18413 consensus_queue.cc:1048] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:55.761677 17129 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:55.717425 17102 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:55.763257 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 45910.4us
I20260201 08:59:55.763625 18413 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:55.717898 17130 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 08:59:55.764186 18413 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:55.719651 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.719980 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.766901 17283 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:55.766958 17211 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e"
dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:45104
I20260201 08:59:55.767297 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:55.767527 17211 raft_consensus.cc:606] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:55.767971 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.733189 18688 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 08:59:55.720257 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.769215 18598 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:55.769570 17285 raft_consensus.cc:2393] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:55.769742 18598 raft_consensus.cc:697] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:55.770726 18598 consensus_queue.cc:237] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.771445 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.772451 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.753053 18362 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.765447 17136 raft_consensus.cc:1275] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:55.775393 18362 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:55.775882 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:55.776690 18362 consensus_queue.cc:1048] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:55.776947 18585 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.800765 17848 raft_consensus.cc:1275] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:55.777908 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.776160 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:55.774073 17174 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:55.719372 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.745868 17284 rpcz_store.cc:276] 0201 08:59:54.115985 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:54.116151 (+ 166us) service_pool.cc:225] Handling call
0201 08:59:54.119594 (+ 3443us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:54.132292 (+ 12698us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:54.132322 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:54.132715 (+ 393us) log.cc:844] Serialized 26 byte log entry
0201 08:59:54.350758 (+218043us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:54.350799 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:54.351053 (+ 254us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:55.741919 (+1390866us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b240042ced8. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74acfe0ad4 00007f74acfdebdb 00007f74ad06dad9 00007f74ad06d765 00007f74ad06ccc0 00007f74afe01828 00007f74afe01f88 00007f74afdd9738 00007f74afdd4b0a 00007f74afdd3f56
0201 08:59:55.744663 (+ 2744us) raft_consensus.cc:1685] finished
0201 08:59:55.744697 (+ 34us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:55.745382 (+ 685us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12399,"raft.queue_time_us":12498,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":73,"spinlock_wait_cycles":12582272,"thread_start_us":217670,"threads_started":1,"wal-append.queue_time_us":348736}
I20260201 08:59:55.792255 17285 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:55.754789 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.723456 18590 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.798764 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.799304 18327 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.715658 18700 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.681313 18701 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.799863 18689 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.752835 18589 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:55.715459 17846 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39002 (request call id 555) took 1628 ms (client timeout 1970 ms). Trace:
I20260201 08:59:55.821861 18271 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.820880 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:55.822237 18589 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:55.821424 17846 rpcz_store.cc:269] 0201 08:59:54.087202 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:54.094914 (+ 7712us) service_pool.cc:225] Handling call
0201 08:59:55.715280 (+1620366us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540000aad4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:55.715404 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":632038784}
I20260201 08:59:55.800558 18673 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.808571 17841 raft_consensus.cc:2393] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:55.824658 17841 raft_consensus.cc:1240] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:55.804711 17845 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
W20260201 08:59:55.719569 18678 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Append to log took a long time: real 0.298s user 0.000s sys 0.000s
I20260201 08:59:55.764196 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.802762 18679 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.811228 18695 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:55.845220 18695 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:55.845618 18695 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
W20260201 08:59:55.846207 18425 consensus_meta.cc:287] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.687s user 0.009s sys 0.001s
I20260201 08:59:55.824707 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.815043 18690 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.815192 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.811401 18675 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.850353 18675 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:55.852308 18675 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.814158 18590 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:55.853184 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.811470 18585 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.853864 17210 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:55.854328 18590 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.854959 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.816133 18693 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.817546 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:55.816687 18327 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.758356 18574 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:55.714233 18699 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.821024 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:55.823030 18653 log.cc:927] Time spent T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 1.101s user 0.000s sys 0.022s
I20260201 08:59:55.830488 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.753872 18562 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.831964 17103 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:55.881691 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 49822.8us
I20260201 08:59:55.881131 17134 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:55.803372 18381 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.810273 17843 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 08:59:55.677505 18539 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:55.881739 18327 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.894325 18539 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.815209 18362 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.894981 18362 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.895349 18327 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.823501 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.837973 18528 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.815726 18422 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.838516 18686 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.840204 18691 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.849754 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:55.855525 17278 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:55.856600 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.905520 17135 raft_consensus.cc:2368] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 08:59:55.856163 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.906312 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.857285 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.885193 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.844966 17129 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:55.887319 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.846657 18425 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.888417 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.911079 17841 raft_consensus.cc:2410] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 08:59:55.891101 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.891613 18562 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:55.891980 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.855516 18585 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.899176 18413 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:55.882800 17203 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:55.899832 17175 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:55.900360 18501 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 08:59:55.900892 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.901283 18663 consensus_queue.cc:1048] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:55.900432 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:55.903434 17793 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:55.904506 18422 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:55.905773 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:55.846560 18701 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.886807 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:55.886440 17248 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:55.912747 18677 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:55.916500 17283 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
W20260201 08:59:55.951308 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 64944.2us
W20260201 08:59:55.951522 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 51777.4us
I20260201 08:59:55.966651 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.968161 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.969712 17103 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:55.971635 18680 log.cc:927] Time spent T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.431s user 0.002s sys 0.001s
I20260201 08:59:55.908447 17842 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:55.973858 18422 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:55.974470 18701 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:55.974830 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:55.975011 18701 raft_consensus.cc:697] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
W20260201 08:59:55.975205 17137 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54340 (request call id 122) took 2696 ms (client timeout 2790 ms). Trace:
I20260201 08:59:55.914886 18362 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 08:59:55.978435 18676 log.cc:927] Time spent T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.402s user 0.002s sys 0.000s
I20260201 08:59:55.978708 17279 raft_consensus.cc:2410] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260201 08:59:55.980279 18659 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:55.980679 18659 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:55.981040 18659 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:55.981105 17248 leader_election.cc:400] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 08:59:55.981428 17248 leader_election.cc:403] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260201 08:59:55.912725 18695 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.982326 17248 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:55.983036 18546 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 08:59:55.983662 18546 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:55.983986 18546 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:55.984289 18546 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:55.984933 18528 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election won for term 3
I20260201 08:59:55.985432 18672 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:55.985935 18672 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:55.987869 18672 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:55.975724 17137 rpcz_store.cc:269] 0201 08:59:53.279019 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:53.452562 (+173543us) service_pool.cc:225] Handling call
0201 08:59:55.974997 (+2522435us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b5400678c54. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:55.975144 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1847178624}
I20260201 08:59:55.985226 18695 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:55.990283 18677 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:55.992256 18677 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:55.992928 17209 raft_consensus.cc:2368] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 08:59:55.962222 18690 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:55.994328 18690 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:55.994679 18690 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:55.975580 17206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 153) took 1272 ms. Trace:
I20260201 08:59:55.998519 17206 rpcz_store.cc:276] 0201 08:59:54.702985 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:54.709091 (+ 6106us) service_pool.cc:225] Handling call
0201 08:59:54.709401 (+ 310us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:54.837219 (+127818us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:54.837254 (+ 35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:54.842791 (+ 5537us) log.cc:844] Serialized 26 byte log entry
0201 08:59:54.996416 (+153625us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b180000b7a0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab 00007f74afdd90c3 00007f74afdd9471 00007f74b01f573f
0201 08:59:55.132451 (+136035us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:55.132491 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:55.132564 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:55.971049 (+838485us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 08:59:55.975402 (+ 4353us) raft_consensus.cc:1685] finished
0201 08:59:55.975422 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:55.975531 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":133221,"raft.queue_time_us":145701,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8412,"spinlock_wait_cycles":10081024,"thread_start_us":135503,"threads_started":1,"wal-append.queue_time_us":569132}
I20260201 08:59:55.994516 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.006163 17134 raft_consensus.cc:1275] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260201 08:59:56.006789 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 234559us
I20260201 08:59:55.913293 18562 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:56.023059 17793 leader_election.cc:400] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 08:59:56.023433 17793 leader_election.cc:403] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:56.027236 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.029546 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.021464 17202 raft_consensus.cc:2393] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:56.036617 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.021687 18422 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.022153 18562 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.042237 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:56.031205 18672 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 6
I20260201 08:59:56.031078 18536 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.021334 18528 raft_consensus.cc:697] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:56.021334 18574 consensus_queue.cc:1048] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260201 08:59:56.059581 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 282632us
I20260201 08:59:56.031419 17102 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.035897 17839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 565) took 1085 ms. Trace:
W20260201 08:59:56.084023 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 52687.1us
I20260201 08:59:56.084903 17102 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.090162 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:56.091542 17102 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:56.047914 18422 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.096356 17794 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:56.098345 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.082576 18701 consensus_queue.cc:237] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.093780 18501 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.099869 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.101133 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:56.103538 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.089080 18569 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:56.126505 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:56.128513 17279 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.116955 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.086599 18271 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:56.130292 17278 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:56.059204 18536 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:56.040907 18546 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.141324 17794 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.150813 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.154426 17794 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.154867 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.096809 18699 consensus_queue.cc:1048] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260201 08:59:56.094080 18327 consensus_queue.cc:1059] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260201 08:59:56.142603 18677 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:56.135741 17276 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:56.142593 18587 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.144021 18425 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:56.174516 17278 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:56.158609 18362 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:56.134285 18569 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:56.163501 18584 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.327s user 0.041s sys 0.105s
I20260201 08:59:56.172456 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.153498 18271 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:56.167042 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.132493 18501 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:56.156664 18381 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.203395 18381 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.198279 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.167174 18677 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:56.152354 18719 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:56.161861 18279 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:56.186702 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.190945 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.161365 18585 raft_consensus.cc:993] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:56.148968 18528 consensus_queue.cc:237] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:56.187813 17280 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:56.186563 18362 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 08:59:56.195458 18584 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.353s user 0.041s sys 0.105s
I20260201 08:59:56.202697 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:56.164654 18674 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 1.044s user 0.000s sys 0.017s
I20260201 08:59:56.166851 18717 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:56.171316 18327 consensus_queue.cc:1243] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer 35484ac93d564e958f85965bd740a18f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260201 08:59:56.193849 18598 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 08:59:56.257193 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 61492us
I20260201 08:59:56.257705 17206 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:56.180915 17794 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.184525 18428 consensus_queue.cc:1048] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260201 08:59:56.255193 18677 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.281829 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:56.285986 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 194496us
I20260201 08:59:56.284375 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.305856 17843 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:56.255995 18536 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.276341 17204 raft_consensus.cc:1275] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:56.308681 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.309934 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.280229 18666 raft_consensus.cc:1081] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:56.280511 18362 raft_consensus.cc:3060] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:56.317189 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.275252 18546 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:56.347317 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 154510us
W20260201 08:59:56.318720 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 137891us
I20260201 08:59:56.286026 18717 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:56.349587 17794 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:56.344399 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 46113.7us
I20260201 08:59:56.353736 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.303485 18687 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:56.286888 18719 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.181509 18587 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.303297 17203 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:56.314549 18271 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.375087 17250 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.375527 18536 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.376209 17249 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.353067 18717 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.377246 17794 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.379542 18704 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.380125 18727 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.319131 18381 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:56.373147 17174 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:56.352574 18679 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:56.303874 18598 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.419678 18598 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.413782 18679 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.420601 18679 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:56.376816 18523 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:56.387526 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 349030us
W20260201 08:59:56.401880 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:56.361912 18422 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.405975 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.372375 18693 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:56.409693 17177 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:56.410162 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:56.428134 17280 raft_consensus.cc:2376] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6. Re-sending same reply.
I20260201 08:59:56.409811 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.352877 18525 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260201 08:59:56.419589 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:56.427469 17101 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.396778 18684 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:56.412422 18670 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:56.443095 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.370857 18687 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.446520 17279 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:56.062395 17839 rpcz_store.cc:276] 0201 08:59:54.950890 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:54.951498 (+ 608us) service_pool.cc:225] Handling call
0201 08:59:54.960931 (+ 9433us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:54.961302 (+ 371us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:54.961335 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:54.961809 (+ 474us) log.cc:844] Serialized 26 byte log entry
0201 08:59:55.157130 (+195321us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:55.161691 (+ 4561us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:55.414744 (+253053us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:55.977928 (+563184us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 08:59:56.001609 (+ 23681us) raft_consensus.cc:1685] finished
0201 08:59:56.008852 (+ 7243us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:56.033011 (+ 24159us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":78412,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":4659456,"thread_start_us":181253,"threads_started":1,"wal-append.queue_time_us":591803}
I20260201 08:59:56.433588 17794 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.403643 18501 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:56.437317 17101 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.373538 18719 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.430562 17250 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:56.421144 18570 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:56.414229 18279 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:56.424010 18381 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.431138 18689 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.452617 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.463577 17279 raft_consensus.cc:2410] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260201 08:59:56.455659 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:56.456346 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:56.465199 17845 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:56.462548 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.408032 18536 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:56.438875 18422 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:56.401743 18271 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.435277 18706 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:56.435811 18598 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:56.413998 18428 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260201 08:59:56.441030 18729 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:56.468429 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.469807 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.470127 18689 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.470710 17136 raft_consensus.cc:3055] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:56.520103 17136 raft_consensus.cc:740] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:56.471239 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.473416 18719 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.471064 18546 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:56.477646 18501 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.497607 18706 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:56.413723 17840 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39002
I20260201 08:59:56.452927 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.487783 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.434975 18575 consensus_queue.cc:1048] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260201 08:59:56.458819 18523 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:56.492093 18536 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.423485 18695 consensus_queue.cc:1048] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260201 08:59:56.443694 18670 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.414602 18704 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.496620 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.475152 18672 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
W20260201 08:59:56.501302 18722 log.cc:927] Time spent T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.078s user 0.000s sys 0.000s
I20260201 08:59:56.520918 17136 consensus_queue.cc:260] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.587637 17136 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:56.542979 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.466411 18569 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:56.503336 18680 log.cc:927] Time spent T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260201 08:59:56.483122 18327 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:56.539373 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.594770 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:56.595891 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.596266 17842 raft_consensus.cc:1275] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:56.539964 18719 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:56.539708 18562 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.598592 18562 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.540297 18546 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:56.599634 18546 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
W20260201 08:59:56.505698 18731 log.cc:927] Time spent T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260201 08:59:56.421857 18727 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:56.534312 18659 consensus_meta.cc:287] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.551s user 0.012s sys 0.005s
W20260201 08:59:56.585497 18690 consensus_meta.cc:287] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.587s user 0.007s sys 0.003s
I20260201 08:59:56.516983 18186 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.493088 18381 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.556828 17845 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:56.540561 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:56.495963 18422 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.542445 18706 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.505842 18598 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.589790 17128 raft_consensus.cc:2393] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:56.591691 18704 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.467804 18279 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.645732 17136 raft_consensus.cc:1275] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 08:59:56.518527 18729 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:56.542543 18501 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.586062 18670 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.638495 18316 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.655365 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.656754 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.657508 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:56.640142 18725 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.258s user 0.001s sys 0.000s
I20260201 08:59:56.663492 17102 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.664548 17136 pending_rounds.cc:85] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 1
I20260201 08:59:56.685869 17136 pending_rounds.cc:107] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 08:59:56.686151 17136 raft_consensus.cc:2889] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:56.607229 18587 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:56.668603 18279 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:56.671733 18677 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.672525 17841 raft_consensus.cc:2468] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 08:59:56.643532 17249 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:56.635564 18681 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:56.635109 18562 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.682799 17207 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:56.684348 17133 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:56.665329 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.652402 18186 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.689047 17204 raft_consensus.cc:1275] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 08:59:56.695674 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.661176 18719 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.700258 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:56.726830 17211 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.701006 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.702787 18677 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:56.704892 18729 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:56.702787 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:56.648141 18690 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:56.696424 18425 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260201 08:59:56.707365 17131 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:56.679623 18689 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:56.710228 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 66799.7us
I20260201 08:59:56.640718 18659 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.711712 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.713411 18693 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.714377 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.716462 18186 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.717501 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.729863 18687 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.718501 18670 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:56.719058 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.679991 18730 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:56.722859 18681 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:56.693383 17132 raft_consensus.cc:1240] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:56.792093 18681 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:56.690088 18316 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:56.794595 18316 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:56.731029 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.731194 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.724335 18719 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:56.751109 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.689460 18327 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:56.695195 18501 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.792488 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.766130 17102 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:56.766269 17135 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:56.729136 18587 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:56.773229 17847 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:56.774477 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.775486 17133 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:56.823848 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:56.779086 18736 log.cc:927] Time spent T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260201 08:59:56.780900 18670 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:56.822860 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 56802.3us
I20260201 08:59:56.713407 18546 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.733716 18562 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:56.729074 18362 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:56.786295 18717 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:56.770622 18693 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:56.790016 18730 raft_consensus.cc:697] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:56.797729 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.748801 18271 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:56.802340 17281 raft_consensus.cc:2368] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:56.802386 17136 raft_consensus.cc:2368] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:56.807422 17211 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:56.762673 18713 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:56.729317 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:56.767866 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.829262 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.829077 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.830714 18587 raft_consensus.cc:697] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:56.861265 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.862027 17136 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:56.837270 18728 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:56.844728 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 08:59:56.834892 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 379273us
W20260201 08:59:56.830058 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 327621us
I20260201 08:59:56.851577 18422 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:56.866825 17133 raft_consensus.cc:2393] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:56.881157 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.881842 17136 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:56.841635 18327 consensus_queue.cc:1048] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260201 08:59:56.858278 18381 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:56.871315 17250 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.887355 17103 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:56.876480 17130 raft_consensus.cc:2368] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
W20260201 08:59:56.834484 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 378875us
I20260201 08:59:56.865697 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.865190 18598 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:56.868642 18728 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:56.866061 18727 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.863332 17277 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:56.874015 18675 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:56.896481 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.898808 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.909823 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:56.913542 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.914126 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.914299 17841 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:56.915014 17843 raft_consensus.cc:2410] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 08:59:56.916006 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.953279 17282 raft_consensus.cc:2393] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:56.954293 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:56.954869 17282 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:56.959165 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:56.960059 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:56.890508 18574 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:56.964700 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.895609 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.982141 17841 raft_consensus.cc:1240] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:56.901336 18422 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 08:59:56.985136 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.986244 17177 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:56.907878 18728 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:56.985203 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:56.991794 17845 raft_consensus.cc:2393] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:56.956090 17840 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:56.890625 18666 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
W20260201 08:59:56.993685 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 234274us
I20260201 08:59:56.995246 17790 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:56.994167 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:57.010326 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:56.983465 18690 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:56.902945 18679 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:56.987524 18659 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.017081 17790 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.029314 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.030177 17209 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:56.996886 18663 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:56.997432 17840 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:56.973614 18675 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:56.997267 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:57.029744 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 126855us
I20260201 08:59:56.984319 18706 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:57.056674 17841 raft_consensus.cc:1275] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 08:59:57.057214 17790 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 08:59:57.029502 18740 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.126s user 0.000s sys 0.000s
I20260201 08:59:57.016783 18719 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.024598 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:56.973059 18587 consensus_queue.cc:237] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.063836 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:57.068334 17790 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.027774 18750 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:57.030423 18546 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.074487 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:57.034412 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.054983 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:56.973281 18730 consensus_queue.cc:237] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.054121 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.057626 18562 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:57.035748 18663 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:57.061969 18381 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:57.060316 18362 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.087229 18699 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260201 08:59:57.107906 18741 log.cc:927] Time spent T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.096s user 0.000s sys 0.000s
W20260201 08:59:57.109279 18739 log.cc:927] Time spent T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.127s user 0.000s sys 0.000s
I20260201 08:59:57.083636 18717 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.074069 18751 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.117712 17175 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.118130 17790 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.129570 17790 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.129678 17175 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:57.130743 17790 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:57.130925 17845 raft_consensus.cc:1240] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:57.083317 17128 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:57.122375 17101 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.122748 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.123118 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.123699 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.124279 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:57.138707 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.092797 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:57.125211 17134 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:57.100757 18663 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:57.125869 18679 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:57.126287 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.144496 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:57.097877 18589 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:57.145154 17843 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:57.145288 18589 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.137077 18699 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:57.146509 18699 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.147231 18589 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:57.127045 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.148387 18699 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.132541 17845 raft_consensus.cc:1240] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 08:59:57.148675 18666 raft_consensus.cc:2804] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:57.137255 18598 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:57.132234 17790 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.149271 18598 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.149693 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.150460 17101 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.150743 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:57.151314 18598 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.141975 17280 raft_consensus.cc:2393] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 08:59:57.143756 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.151829 18598 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.138978 17278 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:57.090705 18753 consensus_queue.cc:1048] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260201 08:59:57.143792 18750 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:57.143797 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.144626 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.154808 17844 raft_consensus.cc:2393] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:57.141824 17205 raft_consensus.cc:2393] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:57.157493 17845 raft_consensus.cc:2393] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 6: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 08:59:57.096479 17276 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:57.161754 17790 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.141484 18672 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 08:59:57.153631 18750 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:57.103971 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.156729 17132 raft_consensus.cc:2393] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:57.165673 17790 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.126540 18562 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:57.167220 17174 leader_election.cc:400] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:57.112447 18706 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:57.149209 18381 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:57.194126 17174 leader_election.cc:403] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260201 08:59:57.194507 17102 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:57.194919 17174 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.193260 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:57.195792 17102 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.142275 18132 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:57.187453 17101 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.169234 18743 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.196163 17174 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.197469 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.202145 17794 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:57.204905 17848 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:57.204708 17843 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:57.207059 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:57.210328 17101 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.211264 17209 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 08:59:57.149296 18666 raft_consensus.cc:697] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:57.236477 17134 raft_consensus.cc:606] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:57.167505 18750 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:57.216959 17793 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.233078 17174 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.164381 18699 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:57.233565 18598 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.247964 17174 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:57.201819 18428 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
I20260201 08:59:57.206282 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:57.206400 18425 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:57.232282 17285 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:57.255336 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:57.244799 18327 consensus_queue.cc:1059] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260201 08:59:57.257422 18327 raft_consensus.cc:3055] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:57.257794 18327 raft_consensus.cc:740] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:57.258533 18327 consensus_queue.cc:260] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.241071 17101 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.167428 18672 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:57.211721 17282 raft_consensus.cc:2468] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:57.200515 18719 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:57.200340 18679 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.263904 17794 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:57.235314 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:57.233989 18362 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:57.237133 18132 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:57.209410 18562 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.237624 18584 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:57.267473 17101 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:57.296998 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 49101.5us
I20260201 08:59:57.297672 17285 raft_consensus.cc:2468] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:57.241978 18717 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:57.301995 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 57186.2us
I20260201 08:59:57.305023 18752 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:57.213201 18381 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:57.250806 18677 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:57.201746 17840 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:57.311959 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 44551.7us
I20260201 08:59:57.260411 18706 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:57.314280 17793 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.318702 18589 raft_consensus.cc:2749] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.318871 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.319648 17209 raft_consensus.cc:2368] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5.
I20260201 08:59:57.321058 17177 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:57.322001 18562 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.322243 18132 raft_consensus.cc:2804] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:57.322775 18132 raft_consensus.cc:697] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:57.323575 18132 consensus_queue.cc:237] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:57.323890 18406 consensus_queue.cc:1059] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:57.265336 18672 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 08:59:57.305959 18742 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.332401 17131 raft_consensus.cc:1275] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:57.299067 18753 raft_consensus.cc:2804] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:57.335021 18753 raft_consensus.cc:697] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:57.335981 18753 consensus_queue.cc:237] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.338243 18666 consensus_queue.cc:237] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.340111 18750 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.332489 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.341204 17844 raft_consensus.cc:1240] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 08:59:57.342424 17846 raft_consensus.cc:1275] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:57.347091 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.349901 18693 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:57.350574 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:57.351601 18709 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.351928 18693 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:57.315109 17101 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.352566 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:57.356073 17250 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 08:59:57.374462 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 59432.8us
I20260201 08:59:57.375218 17101 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.377307 17281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54622 (request call id 694) took 1230 ms. Trace:
I20260201 08:59:57.377672 17281 rpcz_store.cc:276] 0201 08:59:56.147236 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:56.154631 (+ 7395us) service_pool.cc:225] Handling call
0201 08:59:57.377120 (+1222489us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54000a05d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:57.377256 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1487109504}
I20260201 08:59:57.307031 18575 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:57.357393 17135 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:57.358851 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:57.359154 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:57.361522 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.304713 18681 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.311592 18362 raft_consensus.cc:697] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:57.362170 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.361960 17793 leader_election.cc:400] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5.
I20260201 08:59:57.371412 17206 raft_consensus.cc:1240] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:57.371915 17843 raft_consensus.cc:1240] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 08:59:57.343253 18750 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.307351 18327 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:57.305734 18381 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:57.305478 18752 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:57.449769 18575 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:57.450556 18742 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:57.304241 18598 consensus_queue.cc:1048] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260201 08:59:57.455579 18684 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:57.463181 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.464427 17793 leader_election.cc:403] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 08:59:57.484366 17210 raft_consensus.cc:3060] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
W20260201 08:59:57.467052 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 90508.6us
W20260201 08:59:57.455348 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 99368.2us
I20260201 08:59:57.460342 18672 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.442919 18717 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 08:59:57.496806 17847 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39002 (request call id 580) took 1610 ms (client timeout 1793 ms). Trace:
I20260201 08:59:57.497259 17177 leader_election.cc:400] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5.
W20260201 08:59:57.484709 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 122885us
I20260201 08:59:57.499250 17793 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.499884 18693 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 08:59:57.500520 17793 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.489132 17101 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.480201 17135 raft_consensus.cc:1275] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260201 08:59:57.373051 18678 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
W20260201 08:59:57.497993 17847 rpcz_store.cc:269] 0201 08:59:55.886356 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:55.886497 (+ 141us) service_pool.cc:225] Handling call
0201 08:59:57.496648 (+1610151us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54000064d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:57.496753 (+ 105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1869032192}
I20260201 08:59:57.469987 18752 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:57.468022 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.508929 17848 raft_consensus.cc:1240] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 6. Current term is 7. Ops: []
I20260201 08:59:57.482542 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:57.365804 18728 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:57.481923 18659 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:57.490497 18709 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:57.490872 18690 raft_consensus.cc:3060] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:57.510282 17101 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:57.514361 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.520787 17210 raft_consensus.cc:2468] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:57.525112 17101 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:57.506054 18684 raft_consensus.cc:697] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:57.509364 18677 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260201 08:59:57.569571 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 44529.6us
I20260201 08:59:57.502422 18271 consensus_queue.cc:1059] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260201 08:59:57.567080 18729 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 08:59:57.506743 18742 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:57.570674 18717 raft_consensus.cc:2804] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:57.587916 17790 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:57.577800 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 254837us
I20260201 08:59:57.590077 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.594502 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.596308 17790 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.580183 18730 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:57.601523 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:57.578397 18737 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 08:59:57.522469 18362 consensus_queue.cc:237] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:57.528383 18659 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.624888 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:57.625764 17135 raft_consensus.cc:2393] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:57.626569 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:57.627159 17135 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:57.627951 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:57.620790 17790 leader_election.cc:400] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
W20260201 08:59:57.616386 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:57.633459 17103 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.597856 18672 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.603401 18677 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.569871 18709 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:57.644073 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:57.615339 18730 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:57.596791 18422 consensus_queue.cc:1048] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260201 08:59:57.634884 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:57.628983 18589 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:57.686928 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:57.643041 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:57.688750 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 87520.7us
I20260201 08:59:57.681586 18730 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:57.712096 17101 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.713442 18681 consensus_queue.cc:1059] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:57.712098 17790 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.716495 17175 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.689812 18271 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 08:59:57.710785 18684 consensus_queue.cc:237] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 08:59:57.731184 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 97789.8us
I20260201 08:59:57.731859 17103 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.731889 17790 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.733650 18672 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260201 08:59:57.735136 18769 log.cc:927] Time spent T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.153s user 0.001s sys 0.000s
I20260201 08:59:57.739068 18381 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.741657 17793 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:57.710321 18575 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.732125 18753 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:57.755215 17790 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.755771 17103 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:57.758003 17841 raft_consensus.cc:1275] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:57.742534 18744 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 08:59:57.770006 18773 log.cc:927] Time spent T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.053s user 0.000s sys 0.001s
I20260201 08:59:57.773053 17128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 650) took 1122 ms. Trace:
I20260201 08:59:57.757990 18753 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:57.746073 18717 raft_consensus.cc:697] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:57.761742 18539 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260201 08:59:57.761094 18742 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:57.763593 18708 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:57.760659 18186 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:57.787563 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:57.769032 18728 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:57.782848 18753 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:57.791050 18422 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260201 08:59:57.795498 17130 raft_consensus.cc:3060] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:57.783394 18785 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:57.785380 18569 consensus_queue.cc:1059] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260201 08:59:57.805930 18709 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:57.786266 18413 consensus_queue.cc:1059] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260201 08:59:57.797672 18659 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:57.773433 17128 rpcz_store.cc:276] 0201 08:59:56.650523 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:57.144899 (+494376us) service_pool.cc:225] Handling call
0201 08:59:57.145196 (+ 297us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:57.193639 (+ 48443us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:57.209316 (+ 15677us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:57.299471 (+ 90155us) log.cc:844] Serialized 26 byte log entry
0201 08:59:57.570862 (+271391us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:57.577400 (+ 6538us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:57.577480 (+ 80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:57.772802 (+195322us) raft_consensus.cc:1685] finished
0201 08:59:57.772820 (+ 18us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:57.772995 (+ 175us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19218,"raft.queue_time_us":40022,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":13586,"thread_start_us":208245,"threads_started":1,"wal-append.queue_time_us":377215}
I20260201 08:59:57.813642 18717 consensus_queue.cc:237] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.860209 18675 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:57.860780 17130 raft_consensus.cc:1275] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:57.865290 18679 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260201 08:59:57.866675 18780 log.cc:927] Time spent T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
W20260201 08:59:57.869814 18787 log.cc:927] Time spent T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.057s user 0.001s sys 0.000s
W20260201 08:59:57.871596 18663 consensus_meta.cc:287] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.686s user 0.009s sys 0.001s
I20260201 08:59:57.855571 17131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 653) took 1124 ms. Trace:
I20260201 08:59:57.872632 17131 rpcz_store.cc:276] 0201 08:59:56.731011 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:57.333300 (+602289us) service_pool.cc:225] Handling call
0201 08:59:57.333611 (+ 311us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:57.353010 (+ 19399us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:57.353047 (+ 37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:57.353530 (+ 483us) log.cc:844] Serialized 26 byte log entry
0201 08:59:57.734183 (+380653us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:57.734223 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:57.734311 (+ 88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:57.855348 (+121037us) raft_consensus.cc:1685] finished
0201 08:59:57.855378 (+ 30us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:57.855511 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46173,"raft.queue_time_us":30088,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":8439,"thread_start_us":380329,"threads_started":1,"wal-append.queue_time_us":447900}
I20260201 08:59:57.876228 17839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38998 (request call id 507) took 1116 ms. Trace:
I20260201 08:59:57.876654 17839 rpcz_store.cc:276] 0201 08:59:56.760084 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:56.762447 (+ 2363us) service_pool.cc:225] Handling call
0201 08:59:57.812357 (+1049910us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b580017f498. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 08:59:57.850353 (+ 37996us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:57.863793 (+ 13440us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:57.865398 (+ 1605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:57.875895 (+ 10497us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:57.875954 (+ 59us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:57.876048 (+ 94us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:57.876178 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26359680}
I20260201 08:59:57.884457 18690 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5.
I20260201 08:59:57.872182 18663 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:57.815653 18752 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.898156 18752 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:57.908957 17840 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:57.909799 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:57.910246 17840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39002 (request call id 590) took 1524 ms. Trace:
I20260201 08:59:57.910681 17137 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54340 (request call id 159) took 1057 ms. Trace:
I20260201 08:59:57.911108 17840 rpcz_store.cc:276] 0201 08:59:56.394039 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:56.403376 (+ 9337us) service_pool.cc:225] Handling call
0201 08:59:57.904931 (+1501555us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400008cd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b02316bd 00007f74b51f1800 00007f74ae78b3b4 00007f74ae78b342 00007f74ae78b271 00007f74ae78b1ec 00007f74ae78a4a2 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 08:59:57.910157 (+ 5226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":915534080}
I20260201 08:59:57.912458 17137 rpcz_store.cc:276] 0201 08:59:56.853614 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:56.863850 (+ 10236us) service_pool.cc:225] Handling call
0201 08:59:57.909668 (+1045818us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14f12e 000000000035a3c9 00007f74b5179560 00007f74b5241dd4 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 08:59:57.910621 (+ 953us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11918720}
I20260201 08:59:57.917534 18663 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:57.919116 18730 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:57.910166 18753 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:57.924103 18730 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:57.924894 18753 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:57.925385 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:57.926039 17283 raft_consensus.cc:2393] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:57.987423 18562 raft_consensus.cc:993] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2: : Instructing follower 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:57.988052 18327 raft_consensus.cc:1081] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Signalling peer 35484ac93d564e958f85965bd740a18f to start an election
I20260201 08:59:57.992208 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:57.992949 17132 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:57.993166 17839 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e"
dest_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:39018
I20260201 08:59:57.993773 17839 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 08:59:57.994091 17839 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:58.000209 17132 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:58.001538 17136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54340 (request call id 144) took 1543 ms. Trace:
I20260201 08:59:58.001571 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 08:59:58.002507 17844 raft_consensus.cc:2393] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:58.002653 17839 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.004505 17839 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.005534 17790 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:58.006424 18672 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 08:59:58.006919 18672 raft_consensus.cc:697] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:58.007706 18672 consensus_queue.cc:237] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.002038 17136 rpcz_store.cc:276] 0201 08:59:56.460212 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:56.882447 (+422235us) service_pool.cc:225] Handling call
0201 08:59:56.882726 (+ 279us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:56.882931 (+ 205us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 08:59:57.054329 (+171398us) log.cc:844] Serialized 14 byte log entry
0201 08:59:58.000623 (+946294us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b1800157900. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74afde185c 00007f74ad16f2eb 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab 00007f74afdd90c3 00007f74afdd95da
0201 08:59:58.001086 (+ 463us) log.cc:844] Serialized 14 byte log entry
0201 08:59:58.001262 (+ 176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:58.001305 (+ 43us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:58.001346 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:58.001407 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:58.001497 (+ 90us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":209752,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3721,"raft.queue_time_us":171,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":13041920,"thread_start_us":198091,"threads_started":2,"wal-append.queue_time_us":189743}
W20260201 08:59:58.013548 18757 log.cc:927] Time spent T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.750s user 0.004s sys 0.000s
I20260201 08:59:58.014400 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:58.015112 17132 raft_consensus.cc:3055] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Stepping down as leader of term 5
I20260201 08:59:58.015450 17132 raft_consensus.cc:740] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:58.016022 17279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54622 (request call id 712) took 1280 ms. Trace:
I20260201 08:59:58.016431 17279 rpcz_store.cc:276] 0201 08:59:56.735394 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:56.737107 (+ 1713us) service_pool.cc:225] Handling call
0201 08:59:56.743084 (+ 5977us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:56.743438 (+ 354us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:56.743468 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:56.763787 (+ 20319us) log.cc:844] Serialized 26 byte log entry
0201 08:59:56.986010 (+222223us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:56.986048 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:56.986109 (+ 61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:58.013025 (+1026916us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 08:59:58.015701 (+ 2676us) raft_consensus.cc:1685] finished
0201 08:59:58.015727 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:58.015961 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7069,"raft.queue_time_us":791,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":14961,"spinlock_wait_cycles":8747264,"thread_start_us":162857,"threads_started":1,"wal-append.queue_time_us":400210}
I20260201 08:59:58.023221 17132 consensus_queue.cc:260] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.025734 17132 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:58.028709 18772 raft_consensus.cc:3055] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 08:59:58.029184 18772 raft_consensus.cc:740] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:58.029837 18772 consensus_queue.cc:260] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.030823 18772 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:58.034032 17132 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:58.035454 17790 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:58.037606 18672 raft_consensus.cc:2804] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:58.038347 18672 raft_consensus.cc:697] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:58.039247 18672 consensus_queue.cc:237] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.048116 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:58.049063 17137 raft_consensus.cc:2393] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:58.053385 18729 raft_consensus.cc:3055] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:58.053869 18729 raft_consensus.cc:740] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 08:59:58.054628 18729 consensus_queue.cc:260] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:58.055575 18729 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:58.080478 18570 raft_consensus.cc:3055] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:58.081168 18570 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:58.081991 18570 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.083276 18570 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:58.085409 18569 raft_consensus.cc:3055] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Stepping down as leader of term 5
I20260201 08:59:58.085898 18569 raft_consensus.cc:740] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:58.086331 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:58.086727 18569 consensus_queue.cc:260] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.088038 18569 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
W20260201 08:59:58.224081 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:58.304093 18786 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.304685 18786 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:58.306726 18786 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:58.493382 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:58.677655 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:58.743903 18786 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.744520 18786 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:58.746539 18786 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:58.743844 18570 consensus_meta.cc:287] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.660s user 0.012s sys 0.005s
W20260201 08:59:58.754895 18569 consensus_meta.cc:287] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.666s user 0.007s sys 0.003s
I20260201 08:59:58.770532 18679 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.771268 18679 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.773509 18679 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.775856 18132 raft_consensus.cc:3055] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Stepping down as leader of term 5
I20260201 08:59:58.776278 18132 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:58.776391 18679 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.776940 18679 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.777099 18132 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.778261 18132 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:58.779188 18679 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:58.779716 18679 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.780128 18679 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.773602 18800 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.781147 18800 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.782023 18679 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:58.783103 18800 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.790894 18598 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:58.791476 18598 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.791817 18785 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:58.792332 18785 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.794328 18785 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:58.798998 18598 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 08:59:58.831462 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 1.04872e+06us
I20260201 08:59:58.834458 17135 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54340 (request call id 164) took 1248 ms. Trace:
I20260201 08:59:58.834738 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:58.835419 17137 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:58.834968 17135 rpcz_store.cc:276] 0201 08:59:57.585680 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:57.628686 (+ 43006us) service_pool.cc:225] Handling call
0201 08:59:57.632395 (+ 3709us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 08:59:57.632771 (+ 376us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:57.632801 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 08:59:58.816622 (+1183821us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b2c000e5818. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74aeb389b1 00007f74aeb47fe2 00007f74b0275851 00007f74b023a0ba 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22
0201 08:59:58.817123 (+ 501us) log.cc:844] Serialized 26 byte log entry
0201 08:59:58.823968 (+ 6845us) raft_consensus.cc:1645] Marking committed up to 2
0201 08:59:58.833221 (+ 9253us) log.cc:844] Serialized 14 byte log entry
0201 08:59:58.834091 (+ 870us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:58.834164 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 08:59:58.834200 (+ 36us) raft_consensus.cc:1685] finished
0201 08:59:58.834278 (+ 78us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:58.834399 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":8610,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":9100,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":36368,"spinlock_wait_cycles":17203072,"thread_start_us":15391,"threads_started":2,"wal-append.queue_time_us":6849}
I20260201 08:59:58.840792 18598 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.841382 18598 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:58.842335 18362 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.842870 18362 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.843421 18598 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.843966 17137 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:58.844674 18362 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:58.848510 18589 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:58.849109 18589 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.851061 18589 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.854382 18362 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.854959 18362 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.856406 18598 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.857040 18786 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.857012 18598 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.857671 18786 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.859566 18786 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:58.861016 18598 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:58.863972 18362 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:58.906021 17282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54622 (request call id 723) took 1419 ms. Trace:
I20260201 08:59:58.906477 17282 rpcz_store.cc:276] 0201 08:59:57.486357 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:57.486992 (+ 635us) service_pool.cc:225] Handling call
0201 08:59:57.487348 (+ 356us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:57.487559 (+ 211us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 08:59:57.501951 (+ 14392us) log.cc:844] Serialized 14 byte log entry
0201 08:59:58.905462 (+1403511us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b1800403060. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad10146a 00007f74b67875c9 00007f74acfc1160 00007f74ad1893c4 00007f74ad189335 00007f74b0231ce0 00007f74b0244396 00007f74b0254f07 00007f74b0254e88
0201 08:59:58.905641 (+ 179us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:58.905699 (+ 58us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:58.905745 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:58.905811 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:58.905941 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3498,"prepare.queue_time_us":16738,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":4376832}
W20260201 08:59:58.907730 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 1.30048e+06us
I20260201 08:59:58.908499 17248 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:58.924098 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:58.926941 18381 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.937158 18672 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.937613 18672 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.939077 18672 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.939496 18672 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.939847 18672 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.941635 18699 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.942147 18699 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.943578 18699 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.945295 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:58.946573 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:58.947157 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:58.947549 17840 raft_consensus.cc:2410] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260201 08:59:58.948588 18672 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.949431 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:58.950620 17844 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:58.951774 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:58.952494 17840 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:58.954010 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:58.954768 17840 raft_consensus.cc:2393] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 6: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:58.955375 18539 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.955914 18539 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.957029 18589 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.957858 18539 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.957547 18589 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.958076 18750 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:58.958509 18381 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.958665 18750 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.959031 18381 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.959635 18589 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:58.960450 18717 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.960587 18750 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:58.961011 18717 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:58.961652 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:58.962929 18717 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:58.961010 18381 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.965440 18709 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:58.965972 18709 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.966617 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:58.967240 17132 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:58.967387 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:58.967798 18709 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:58.969194 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:58.969986 17131 raft_consensus.cc:2393] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 08:59:58.971931 17137 raft_consensus.cc:1275] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 08:59:58.973400 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 141161us
W20260201 08:59:58.977358 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:58.979033 18501 consensus_queue.cc:1059] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:58.979620 18709 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:58.979925 18413 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:58.980293 18406 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:58.980173 18709 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.980823 18406 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:58.981745 18584 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:58.982097 18709 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.982262 18584 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.982579 18709 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.983104 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:58.983031 18709 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.983737 17134 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:58.984102 18584 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.982648 18406 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.984795 18406 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.985021 18718 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:58.985532 18718 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:58.985330 18406 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:58.987397 18718 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.987725 18406 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:58.987913 18718 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:58.980450 18525 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:58.989192 18525 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:58.989487 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:58.989708 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:58.990103 17137 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:58.990340 17134 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:58.991120 18525 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:58.992175 18539 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.992671 18539 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.994562 18539 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.995072 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:58.995000 18539 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:58.995682 17207 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:58.996022 18539 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:58.996593 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:58.997714 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:58.997861 18539 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:58.998164 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:58.998958 17134 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 08:59:58.999322 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.000363 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.000929 17840 raft_consensus.cc:1275] T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:59.001209 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:59.003127 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.003224 17202 raft_consensus.cc:3055] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 08:59:59.003609 17202 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:59.003240 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.003717 17840 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 08:59:59.004729 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.005380 17134 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:59.006206 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.009073 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.010251 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.010700 17101 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.008004 18749 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 08:59:59.012529 17101 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.013811 17793 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:59.015722 17839 raft_consensus.cc:1240] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260201 08:59:59.017635 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:59.018941 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 08:59:59.019317 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:58.998263 17207 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:59.022635 17790 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.024178 17135 raft_consensus.cc:1275] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 08:59:59.025422 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.027843 17839 raft_consensus.cc:1275] T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 08:59:59.028839 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:58.984623 18584 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.030406 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.030519 18584 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.031457 18786 consensus_queue.cc:1048] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:59.029405 18569 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.032264 18569 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.026063 17841 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:59.012916 18666 raft_consensus.cc:3055] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Stepping down as leader of term 6
I20260201 08:59:59.013550 18729 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:59.033828 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.033954 17101 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.034897 17790 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:58.988468 18718 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.035394 18584 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.038715 17135 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:59.045243 17135 raft_consensus.cc:606] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:59.045655 17135 raft_consensus.cc:614] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260201 08:59:59.039740 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:59.041505 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:59.034430 18539 raft_consensus.cc:2804] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:59.030735 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.042964 17129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 518) took 2136 ms. Trace:
I20260201 08:59:59.025259 18730 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:58.984809 18709 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.044070 17790 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.042795 18569 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.046415 17204 raft_consensus.cc:3055] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Stepping down as leader of term 5
I20260201 08:59:59.046785 18708 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:59.013932 18749 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.058145 18708 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.058352 17135 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:59.049984 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.013345 18413 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.059450 18749 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.029158 18381 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:59.060211 18381 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.060412 18413 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.060806 18381 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.038825 18743 consensus_queue.cc:1048] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260201 08:59:59.061172 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:59.052978 18730 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.035969 18666 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:59.062855 18730 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.063521 18666 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.043987 18786 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:59.065181 18786 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.065550 18786 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:59.056036 17175 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:59.067255 17790 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.067562 17843 raft_consensus.cc:1275] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:59.067958 17135 raft_consensus.cc:606] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 08:59:59.055545 17204 raft_consensus.cc:740] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:59.068605 17135 raft_consensus.cc:614] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:59.069084 17204 consensus_queue.cc:260] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.069679 17204 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.037776 18729 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.058550 18708 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:59.050555 17129 rpcz_store.cc:276] 0201 08:59:56.906337 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:57.345355 (+439018us) service_pool.cc:225] Handling call
0201 08:59:57.345696 (+ 341us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 08:59:58.920159 (+1574463us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:58.920193 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 08:59:58.920243 (+ 50us) raft_consensus.cc:1645] Marking committed up to 1
0201 08:59:58.920275 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 08:59:59.042743 (+122468us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54001dc9d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 08:59:59.042791 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 08:59:59.042907 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3620304768}
I20260201 08:59:59.052263 17202 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.081791 17202 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:59.082551 17790 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.083518 18752 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:59.083855 17790 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.084570 18800 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:59.084928 18800 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 08:59:59.084936 18428 consensus_queue.cc:1175] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "35484ac93d564e958f85965bd740a18f" responder_term: 4 status { last_received { term: 4 index: 3 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: [3.3-3.3]" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 08:59:59.085167 18752 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260201 08:59:59.057626 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 1.55358e+06us
I20260201 08:59:59.085861 18800 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:59.087041 18381 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.070880 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:59.067422 17281 raft_consensus.cc:1275] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 08:59:59.091398 17845 raft_consensus.cc:1240] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:59.074530 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.075276 18750 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 08:59:59.064666 18666 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 08:59:59.094321 17174 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:59.073078 17841 raft_consensus.cc:2393] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:59.076625 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:59.076963 18362 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.078991 16958 catalog_manager.cc:5654] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 4, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 08:59:59.080210 18729 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.091141 17280 raft_consensus.cc:3060] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.038448 18772 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260201 08:59:59.101220 16958 catalog_manager.cc:5654] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 3, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 3 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 08:59:59.102598 16958 catalog_manager.cc:5654] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:59.076093 17285 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:59.050210 18539 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:59.097700 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 189284us
I20260201 08:59:59.095309 18750 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.098912 17277 raft_consensus.cc:3060] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.072144 17793 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.104096 16958 catalog_manager.cc:5654] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } }
I20260201 08:59:59.099327 18362 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.106631 17248 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.087561 18672 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:59.133050 18672 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.133452 18672 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:59.133627 17210 raft_consensus.cc:1275] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:59.137246 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:59.092909 18562 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.138008 18566 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.137127 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.138557 18566 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:59.091296 18706 consensus_queue.cc:1175] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3dee892ea94d4f2a92316ad6f79edca2" responder_term: 3 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 08:59:59.139298 18659 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.139813 18659 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.140478 18566 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.110649 17793 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 08:59:59.117615 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 61614.2us
I20260201 08:59:59.142565 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.108604 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.143813 18558 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:59.144261 17129 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:59.112203 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.122836 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.145155 17135 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 08:59:59.108894 18750 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.145354 17276 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:59.146198 18799 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:59.146579 18799 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.146921 18799 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.147127 17846 raft_consensus.cc:1275] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 08:59:59.148401 18752 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.107426 18539 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:59.149174 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.107863 18413 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:59.150501 18413 raft_consensus.cc:697] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 08:59:59.150782 17103 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.194.68:45925 timed out after 1.886s (SENT) [suppressed 5 similar messages]
I20260201 08:59:59.152331 17210 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:59.106137 18717 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:59.153111 18717 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.153246 18752 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.125536 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.155238 18752 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.145486 17844 raft_consensus.cc:1240] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 08:59:59.126142 17131 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
mode: GRACEFUL
new_leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
from {username='slave'} at 127.0.0.1:54328
I20260201 08:59:59.127758 18186 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:59.157019 18675 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.157271 18186 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.157593 18546 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:59.157763 18684 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.158622 18713 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.158443 18675 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.159060 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:59.158385 17278 raft_consensus.cc:1275] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260201 08:59:59.159986 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 53410.9us
I20260201 08:59:59.123358 18362 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.116204 18410 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 08:59:59.167866 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.164428 17790 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.169915 18716 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 08:59:59.171263 18186 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:59.171753 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.172690 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.158126 18546 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.152817 18413 consensus_queue.cc:237] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.173826 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.168542 17841 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 08:59:59.159184 18713 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.174805 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.176613 18713 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.157203 17131 raft_consensus.cc:606] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Received request to transfer leadership to TS f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:59.177639 18501 consensus_queue.cc:1059] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:59.178346 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.178943 17210 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 08:59:59.174844 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.182432 17790 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.177346 18659 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.182102 17202 raft_consensus.cc:1275] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260201 08:59:59.183364 17202 pending_rounds.cc:85] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: Aborting all ops after (but not including) 2
I20260201 08:59:59.183573 17202 pending_rounds.cc:107] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260201 08:59:59.127604 16958 catalog_manager.cc:5654] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 4, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 4 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 08:59:59.132122 17204 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:59.132325 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.185375 16958 catalog_manager.cc:5654] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 08:59:59.137462 17206 raft_consensus.cc:1240] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:59.138161 18562 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.144374 18558 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.106505 18117 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:59.127887 18569 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:59.203748 17793 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:59.092556 18584 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260201 08:59:59.158696 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.177433 17131 raft_consensus.cc:614] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 08:59:59.128381 18570 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.159636 17283 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.170138 18410 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:59.158308 18684 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.183822 17202 raft_consensus.cc:2889] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 08:59:59.158295 18575 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.181448 17177 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:59.153268 18706 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260201 08:59:59.199113 18693 raft_consensus.cc:2804] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 08:59:59.225746 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.231123 18575 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.231145 18570 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.232702 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.226224 18715 consensus_queue.cc:1048] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260201 08:59:59.226080 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.233973 18570 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.184481 17208 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 08:59:59.224915 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.224470 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 08:59:59.235345 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 53966.7us
I20260201 08:59:59.235527 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.236200 17130 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 1.
I20260201 08:59:59.225739 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.236678 17177 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:59.237386 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.237974 18706 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 08:59:59.238068 18749 consensus_queue.cc:1048] T d454a89732b54703b564e1c647bbb335 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 08:59:59.238392 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.238639 18709 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 08:59:59.202695 18117 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.236974 18693 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.234654 17211 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 08:59:59.239894 17279 raft_consensus.cc:3060] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:59.240494 18693 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:59.231858 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.242689 18684 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.129150 17280 raft_consensus.cc:2468] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:59.206890 18569 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.243867 18569 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:59.244675 17281 raft_consensus.cc:1275] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 08:59:59.224013 18528 consensus_queue.cc:1048] T aec9b4feb0a8410c98176562346a7ca9 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260201 08:59:59.246634 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.235057 18410 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.247681 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.247797 18410 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:59.247995 18750 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.229774 18132 raft_consensus.cc:3055] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:59.227622 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.249496 18132 raft_consensus.cc:740] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 08:59:59.250294 18132 consensus_queue.cc:260] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.251437 18132 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.234308 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.227360 18558 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:59.239063 18425 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.223925 18743 raft_consensus.cc:2804] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 08:59:59.239578 18117 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:59.227885 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.234304 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.243799 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.209590 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 08:59:59.211333 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 60567.6us
I20260201 08:59:59.196725 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.189904 16957 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51064 (request call id 149) took 8076 ms. Trace:
I20260201 08:59:59.198854 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.258234 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:59.199746 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.257700 17209 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 08:59:59.265619 17278 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:59.160806 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.155254 18717 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.207103 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.277575 17133 raft_consensus.cc:2468] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 08:59:59.209286 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.256768 17177 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:59.278811 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.279613 17177 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:59.252794 17279 raft_consensus.cc:2468] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:59.257006 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.262010 17283 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:59.195680 17101 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.282045 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:59.282200 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 86596.2us
W20260201 08:59:59.284397 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:59.287874 17842 raft_consensus.cc:1240] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
I20260201 08:59:59.286480 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.295212 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.296598 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.301358 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:59.302088 17133 raft_consensus.cc:3060] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.174849 18546 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.200417 18186 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.322971 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260201 08:59:59.223717 18381 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.266480 16957 rpcz_store.cc:276] 0201 08:59:51.109937 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:51.120037 (+ 10100us) service_pool.cc:225] Handling call
0201 08:59:59.180528 (+8060491us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 08:59:54.744270 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 08:59:54.755607 (+ 11337us) write_op.cc:432] Acquiring schema lock in shared mode
0201 08:59:54.756299 (+ 692us) write_op.cc:435] Acquired schema lock
0201 08:59:54.756320 (+ 21us) tablet.cc:660] Decoding operations
0201 08:59:54.854548 (+ 98228us) write_op.cc:620] Acquiring the partition lock for write op
0201 08:59:54.858340 (+ 3792us) write_op.cc:641] Partition lock acquired for write op
0201 08:59:54.867110 (+ 8770us) tablet.cc:683] Acquiring locks for 11 operations
0201 08:59:54.978560 (+111450us) tablet.cc:699] Row locks acquired
0201 08:59:54.978579 (+ 19us) write_op.cc:260] PREPARE: finished
0201 08:59:54.978717 (+ 138us) write_op.cc:270] Start()
0201 08:59:54.978838 (+ 121us) write_op.cc:276] Timestamp: P: 1769936394978673 usec, L: 0
0201 08:59:54.978862 (+ 24us) op_driver.cc:348] REPLICATION: starting
0201 08:59:54.979530 (+ 668us) log.cc:844] Serialized 4421 byte log entry
0201 08:59:55.718491 (+738961us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 08:59:56.377900 (+659409us) op_driver.cc:464] REPLICATION: finished
0201 08:59:56.995716 (+617816us) write_op.cc:301] APPLY: starting
0201 08:59:57.000703 (+ 4987us) tablet.cc:1365] starting BulkCheckPresence
0201 08:59:57.061548 (+ 60845us) tablet.cc:1368] finished BulkCheckPresence
0201 08:59:57.063425 (+ 1877us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 08:59:57.126380 (+ 62955us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 08:59:57.126583 (+ 203us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0201 08:59:57.126631 (+ 48us) write_op.cc:312] APPLY: finished
0201 08:59:57.248400 (+121769us) log.cc:844] Serialized 82 byte log entry
0201 08:59:57.294985 (+ 46585us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:57.306877 (+ 11892us) write_op.cc:454] Released schema lock
0201 08:59:57.315375 (+ 8498us) write_op.cc:341] FINISH: Updating metrics
0201 08:59:57.482397 (+167022us) write_op.cc:489] Releasing partition, row and schema locks
0201 08:59:57.490154 (+ 7757us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":125333,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":583810,"apply.run_cpu_time_us":4584,"apply.run_wall_time_us":396093,"num_ops":11,"prepare.queue_time_us":475147,"prepare.run_cpu_time_us":53551,"prepare.run_wall_time_us":364513,"raft.queue_time_us":475486,"raft.run_cpu_time_us":52129,"raft.run_wall_time_us":400925,"replication_time_us":1398884,"spinlock_wait_cycles":9652480,"thread_start_us":926345,"threads_started":4,"wal-append.queue_time_us":153370,"wal-append.run_cpu_time_us":34602,"wal-append.run_wall_time_us":3660131}]]}
I20260201 08:59:59.333408 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.334708 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.335426 17280 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 08:59:59.335775 17283 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:59.311378 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.322573 17250 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.333572 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.335489 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 08:59:59.225625 18562 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.253950 18752 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:59.253705 18558 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:59.362076 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260201 08:59:59.366760 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 48097.1us
W20260201 08:59:59.367648 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 45177.2us
I20260201 08:59:59.368446 17250 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:59.308519 18570 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:59.207264 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 08:59:59.254528 18743 raft_consensus.cc:697] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:59.255523 18675 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.308097 18362 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260201 08:59:59.362279 17175 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:59.379150 17250 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 08:59:59.374305 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 191348us
I20260201 08:59:59.288524 18528 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:59.276088 17277 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:59.308184 17128 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 08:59:59.253758 18425 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.404182 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.310204 18679 consensus_queue.cc:1048] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260201 08:59:59.362079 18677 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:59.404126 17177 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:59.381023 18570 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:59.395157 17285 raft_consensus.cc:1240] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 08:59:59.406037 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.367615 18718 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.408802 17133 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
W20260201 08:59:59.366420 18812 log.cc:927] Time spent T c3d3eb882b354a0089a1a129ce4be4c1 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260201 08:59:59.389420 18760 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 08:59:59.384994 18566 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:59.388203 18362 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 08:59:59.423303 18362 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.416591 18569 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.308233 18799 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 08:59:59.422540 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 137662us
I20260201 08:59:59.429955 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:59.378186 18713 consensus_queue.cc:1059] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260201 08:59:59.363603 18186 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.406159 18675 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:59.374336 18752 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.419902 18570 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.427524 18760 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.439536 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.379485 18558 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.447680 17848 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6. Ops: []
I20260201 08:59:59.449455 18425 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.452749 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.439191 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 08:59:59.459285 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:59.432946 18501 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260201 08:59:59.468396 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 65515.6us
I20260201 08:59:59.418787 18677 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.436234 18562 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.475581 17841 raft_consensus.cc:2393] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:59.442946 18730 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.478657 18677 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.479244 18677 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:59.479662 18677 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.480437 18539 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.481328 18575 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.482499 18539 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.483217 18677 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.484139 18117 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 08:59:59.486109 18117 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.486760 17846 raft_consensus.cc:1240] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 08:59:59.488538 18186 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.489503 18566 raft_consensus.cc:3055] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Stepping down as leader of term 4
I20260201 08:59:59.489908 18566 raft_consensus.cc:740] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 08:59:59.490653 18566 consensus_queue.cc:260] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.491427 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.492033 18566 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.493125 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.493793 17203 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 08:59:59.495529 17276 raft_consensus.cc:1240] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:59.495674 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.493800 17284 raft_consensus.cc:1240] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:59.499249 17250 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:59.469347 18569 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.503757 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 08:59:59.504040 18805 log.cc:927] Time spent T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.062s user 0.001s sys 0.000s
I20260201 08:59:59.464682 18760 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 08:59:59.461406 18589 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 08:59:59.517747 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 106364us
I20260201 08:59:59.471674 18501 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 08:59:59.505463 18713 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.522800 18730 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.522966 18713 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.474428 17277 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 08:59:59.523403 17846 raft_consensus.cc:2393] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 6: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:59.513521 18716 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:59.520004 17790 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 08:59:59.529791 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 338254us
I20260201 08:59:59.518354 18750 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:59.490679 18708 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.515391 18269 consensus_queue.cc:1059] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260201 08:59:59.506085 18562 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.524628 18501 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 08:59:59.537052 18717 consensus_queue.cc:1048] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 08:59:59.537487 18799 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.538626 17102 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.541190 17177 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 08:59:59.521050 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:59.536300 18729 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.517468 18117 consensus_queue.cc:1059] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260201 08:59:59.446194 18743 consensus_queue.cc:237] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 08:59:59.532049 18716 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.519297 18589 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.556875 17843 raft_consensus.cc:1240] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
W20260201 08:59:59.551307 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 97535.4us
I20260201 08:59:59.575930 17102 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 08:59:59.578657 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:59.530853 18804 consensus_queue.cc:1059] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
W20260201 08:59:59.601110 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 173878us
I20260201 08:59:59.583206 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.580129 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.603868 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.604511 17206 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 08:59:59.605021 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:59.605304 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.605543 17207 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.606009 17209 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 08:59:59.605223 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 08:59:59.607754 17211 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:59.607645 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:59.602643 17175 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:59.555244 18425 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 08:59:59.552899 18815 raft_consensus.cc:2804] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:59.573541 18569 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:59.612777 17794 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:59.613373 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.573884 18730 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.614529 17278 raft_consensus.cc:2393] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 08:59:59.613554 17280 raft_consensus.cc:1240] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 5. Current term is 6. Ops: []
I20260201 08:59:59.579634 18716 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.600977 18558 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 08:59:59.629555 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:59.609931 18428 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 08:59:59.665503 18752 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 08:59:59.642616 17285 raft_consensus.cc:1240] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:59.577194 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 08:59:59.646310 17207 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 08:59:59.576735 18672 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.691867 17211 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 08:59:59.611902 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:59.579713 18693 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.575115 18785 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260201 08:59:59.606441 18800 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.693610 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.615394 18569 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
W20260201 08:59:59.697391 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 84691us
W20260201 08:59:59.747653 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 155184us
I20260201 08:59:59.748317 17102 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.749359 17102 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:59.694815 18717 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:59.754175 17794 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 08:59:59.755748 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 08:59:59.766919 17211 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 08:59:59.773804 17794 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 08:59:59.699422 18569 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:59.675052 18730 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 08:59:59.776631 17278 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 08:59:59.760000 17277 raft_consensus.cc:2368] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
W20260201 08:59:59.691390 17158 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4c60 after lost signal to thread 14092
I20260201 08:59:59.777885 17128 raft_consensus.cc:2393] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
W20260201 08:59:59.794238 18666 consensus_meta.cc:287] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.697s user 0.008s sys 0.001s
I20260201 08:59:59.758805 18823 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 08:59:59.771229 18813 log.cc:927] Time spent T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20260201 08:59:59.776217 18425 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 08:59:59.771580 18717 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 08:59:59.776953 18820 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election won for term 5
I20260201 08:59:59.754921 18799 consensus_queue.cc:1048] T b58ae14986de4b32bbd4ae3d2b530783 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260201 08:59:59.850872 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 101574us
I20260201 08:59:59.777662 18815 raft_consensus.cc:697] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 08:59:59.869158 17102 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 08:59:59.872215 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.801115 18425 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 08:59:59.853856 18717 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.852322 18713 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.863168 18708 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:59.795711 18410 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 08:59:59.872983 17158 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3340 after lost signal to thread 16994
I20260201 08:59:59.869508 18562 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 08:59:59.882753 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 08:59:59.868901 18729 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 08:59:59.872129 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.900105 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.900619 17133 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 08:59:59.901871 17278 raft_consensus.cc:2410] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260201 08:59:59.878131 18425 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 08:59:59.876267 18823 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 08:59:59.878207 18546 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 08:59:59.915303 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.915581 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.903635 17135 raft_consensus.cc:1240] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260201 08:59:59.877497 18589 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 08:59:59.912451 17158 debug-util.cc:398] Leaking SignalData structure 0x7b080012f180 after lost signal to thread 17161
W20260201 08:59:59.912663 18822 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Append to log took a long time: real 0.336s user 0.002s sys 0.000s
I20260201 08:59:59.913549 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.969434 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.913350 18815 consensus_queue.cc:237] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 08:59:59.914904 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 08:59:59.972647 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.972959 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.974881 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.975675 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.983680 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 08:59:59.984551 17131 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
W20260201 08:59:59.912672 18824 log.cc:927] Time spent T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.150s user 0.001s sys 0.000s
I20260201 09:00:00.005791 17133 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 08:59:59.990370 17211 raft_consensus.cc:1240] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
W20260201 09:00:00.035769 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 262035us
I20260201 08:59:59.993816 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.037961 17250 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:00.041004 17847 raft_consensus.cc:2393] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:00.041201 17794 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 08:59:59.890414 18825 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:00.050585 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.052162 17210 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:00.017455 17283 raft_consensus.cc:1240] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 08:59:59.909381 18575 consensus_queue.cc:1059] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260201 08:59:59.915408 18410 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:00.051189 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 79513.2us
I20260201 09:00:00.078383 17843 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:00.079176 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.079195 17174 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:00.080045 17131 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
W20260201 09:00:00.050221 17158 debug-util.cc:398] Leaking SignalData structure 0x7b08002f1a00 after lost signal to thread 17162
I20260201 09:00:00.089994 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 09:00:00.087152 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:00.090876 17790 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:00.090613 17131 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 08:59:59.910497 18823 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.034272 18693 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:00.090245 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 08:59:59.989646 18828 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:00.093320 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:00.094403 17841 raft_consensus.cc:1240] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:00.094918 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.109892 17133 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
W20260201 09:00:00.110594 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 69479.4us
I20260201 09:00:00.111955 17794 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:00.095639 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.098898 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:00.075969 18688 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:00.052798 18672 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 08:59:59.903798 18830 consensus_queue.cc:1048] T 4f1aa904185346f688e8877d1046ed2e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.184s
I20260201 09:00:00.115613 17131 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
W20260201 09:00:00.119771 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 09:00:00.120478 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:00.050657 18825 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:00.112833 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.126026 17790 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 08:59:59.969575 18546 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.088662 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.129932 18688 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:00.094667 18811 raft_consensus.cc:3055] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:00.100901 18823 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:00.128517 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 09:00:00.108884 18818 log.cc:927] Time spent T aec9b4feb0a8410c98176562346a7ca9 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.241s user 0.000s sys 0.002s
I20260201 09:00:00.143704 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.109189 17203 raft_consensus.cc:1240] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:00.134577 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.107560 18730 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:00.148593 17794 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.128556 18729 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:00.145673 18566 consensus_meta.cc:287] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.650s user 0.013s sys 0.004s
I20260201 09:00:00.107340 18575 consensus_queue.cc:1059] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260201 09:00:00.140487 18675 raft_consensus.cc:3055] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:00.166349 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.133193 18410 raft_consensus.cc:2804] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
W20260201 09:00:00.147886 17158 debug-util.cc:398] Leaking SignalData structure 0x7b080008b0c0 after lost signal to thread 17235
I20260201 09:00:00.170742 17285 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:00.137341 18825 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:00.135146 18693 raft_consensus.cc:2804] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:00.174357 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.202745 17131 raft_consensus.cc:2393] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
W20260201 09:00:00.197921 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 71987.9us
I20260201 09:00:00.203642 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.203824 17790 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:00.205139 18831 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:00.205551 18831 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.205888 18831 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:00.211072 18695 raft_consensus.cc:3055] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:00.193537 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.194262 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.146500 18428 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:00.149768 18811 raft_consensus.cc:740] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
W20260201 09:00:00.198818 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 119706us
I20260201 09:00:00.200994 17283 raft_consensus.cc:2393] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:00.152108 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:00.212033 18269 raft_consensus.cc:3055] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 09:00:00.150804 18688 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:00.206333 18837 raft_consensus.cc:2804] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:00.167176 17137 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:00.169085 18675 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:00.222751 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.250808 17846 raft_consensus.cc:1240] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:00.250718 18675 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:00.251566 18786 consensus_meta.cc:287] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 1.186s user 0.011s sys 0.000s
I20260201 09:00:00.252002 18786 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.163784 18847 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:00.259347 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:00.170385 18729 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.263196 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.235067 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 09:00:00.235355 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 86827.6us
I20260201 09:00:00.236080 17103 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:00.237255 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 129039us
I20260201 09:00:00.239663 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:00.239663 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:00.204233 18834 log.cc:927] Time spent T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.294s user 0.000s sys 0.000s
I20260201 09:00:00.234391 17278 raft_consensus.cc:2368] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:00.201566 18558 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:00.268996 17174 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.270107 17282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54622 (request call id 743) took 1013 ms. Trace:
W20260201 09:00:00.261236 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 223407us
I20260201 09:00:00.270583 17282 rpcz_store.cc:276] 0201 08:59:59.257071 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:59.266691 (+ 9620us) service_pool.cc:225] Handling call
0201 08:59:59.267077 (+ 386us) raft_consensus.cc:1471] Updating replica for 2 ops
0201 08:59:59.267468 (+ 391us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 08:59:59.267497 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0201 08:59:59.268087 (+ 590us) log.cc:844] Serialized 52 byte log entry
0201 08:59:59.529028 (+260941us) raft_consensus.cc:1645] Marking committed up to 3
0201 08:59:59.776291 (+247263us) log.cc:844] Serialized 14 byte log entry
0201 09:00:00.260303 (+484012us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b18001c28e0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74afde185c 00007f74ad16f2eb 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad189335 00007f74b0231ce0 00007f74b0244396 00007f74b0254f07
0201 09:00:00.260413 (+ 110us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:00.260480 (+ 67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:00.260521 (+ 41us) raft_consensus.cc:1685] finished
0201 09:00:00.269895 (+ 9374us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:00.270052 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":333607,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":27805,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":22250,"spinlock_wait_cycles":3050752,"thread_start_us":491604,"threads_started":3,"wal-append.queue_time_us":331773}
I20260201 09:00:00.221382 18695 raft_consensus.cc:740] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:00.309520 17793 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:00.273913 17131 raft_consensus.cc:1275] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:00.265741 17208 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:00.276511 17174 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.242951 18269 raft_consensus.cc:740] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:00.279371 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.280150 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:00.281225 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.316149 17845 raft_consensus.cc:2393] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 7: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:00.124615 18828 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.282955 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.318787 17793 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:00.283335 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.284235 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.285015 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.287339 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.289486 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.290421 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.291370 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.292830 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.297659 18840 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:00.259745 18847 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:00.307618 18729 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.234656 18693 raft_consensus.cc:697] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:00.234313 18410 raft_consensus.cc:697] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:00.243378 18539 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:00.278457 18785 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260201 09:00:00.259366 18132 consensus_meta.cc:287] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 1.008s user 0.009s sys 0.003s
I20260201 09:00:00.282429 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:00.329164 18558 raft_consensus.cc:2804] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:00.310510 18838 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:00.246083 18428 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:00.264474 18837 raft_consensus.cc:697] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:00.324427 18851 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:00.310312 18804 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:00.327402 18672 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:00.321476 18855 raft_consensus.cc:2804] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 09:00:00.420123 18269 consensus_queue.cc:260] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.457679 18546 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:00.577868 18570 consensus_meta.cc:287] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 1.108s user 0.010s sys 0.003s
I20260201 09:00:00.579088 18269 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:00.578660 18570 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.413983 18558 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.306072 17130 raft_consensus.cc:2393] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 2: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:00.314706 17174 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:00.260752 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 09:00:00.541709 17158 debug-util.cc:398] Leaking SignalData structure 0x7b08003840a0 after lost signal to thread 17309
W20260201 09:00:00.595160 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 280418us
W20260201 09:00:00.564158 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 254934us
I20260201 09:00:00.405829 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.566694 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.597406 18546 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260201 09:00:00.569442 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 307303us
I20260201 09:00:00.599771 18546 consensus_queue.cc:1059] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 09:00:00.400451 17793 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 09:00:00.601521 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 09:00:00.602963 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 202491us
I20260201 09:00:00.401072 17794 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.418568 17840 raft_consensus.cc:2393] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:00.416136 18410 consensus_queue.cc:237] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:00.605415 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 231251us
I20260201 09:00:00.607815 17174 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.428318 18117 consensus_queue.cc:1059] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260201 09:00:00.580950 18501 consensus_meta.cc:287] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 1.023s user 0.007s sys 0.009s
I20260201 09:00:00.582248 18562 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.609609 18501 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.609956 18562 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.610961 17210 raft_consensus.cc:1240] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:00.612454 18562 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 09:00:00.453630 18362 consensus_meta.cc:287] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 1.030s user 0.009s sys 0.001s
I20260201 09:00:00.614552 18681 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:00.614286 18362 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.615500 18681 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:00.615933 18681 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.616288 18681 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:00.275957 17103 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.616919 18501 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.617277 17129 raft_consensus.cc:1240] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:00.618258 18598 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260201 09:00:00.618839 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 342800us
W20260201 09:00:00.582607 18569 consensus_meta.cc:287] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.787s user 0.005s sys 0.004s
I20260201 09:00:00.582031 17248 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:00.620400 18569 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.621773 17211 raft_consensus.cc:1240] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:00.623042 18569 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.586246 17204 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260201 09:00:00.587723 18425 consensus_meta.cc:287] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.660s user 0.010s sys 0.000s
I20260201 09:00:00.624742 18425 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.626062 17132 raft_consensus.cc:1240] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:00.627117 18425 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.581494 18558 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
W20260201 09:00:00.595279 17158 debug-util.cc:398] Leaking SignalData structure 0x7b0800384080 after lost signal to thread 17310
W20260201 09:00:00.545962 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:00.603261 18570 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.456647 18672 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:00.629451 18672 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 09:00:00.630563 17158 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0120 after lost signal to thread 17873
I20260201 09:00:00.585175 18428 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:00.473127 18693 consensus_queue.cc:237] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.641430 18699 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:00.642338 18699 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:00.467104 18716 consensus_meta.cc:287] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.787s user 0.008s sys 0.000s
I20260201 09:00:00.464439 18786 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:00.481215 18800 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:00.401943 18811 consensus_queue.cc:260] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:00.485790 18820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s user 0.001s sys 0.002s
W20260201 09:00:00.715519 18820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s user 0.001s sys 0.002s
I20260201 09:00:00.715925 18820 raft_consensus.cc:697] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:00.716285 18850 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:00.708385 18546 raft_consensus.cc:3055] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:00.717280 18546 raft_consensus.cc:740] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:00.717528 18820 consensus_queue.cc:237] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.469532 18823 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.719658 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.716138 18699 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:00.721915 17136 raft_consensus.cc:2393] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:00.722059 18823 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.449800 18828 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.722664 18868 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:00.488772 18831 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.723430 18868 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.725292 18831 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:00.473271 18837 consensus_queue.cc:237] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.409487 18840 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:00.729044 17137 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 09:00:00.729611 18840 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:00.707402 18804 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.730140 18868 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:00.406710 18847 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 09:00:00.717648 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 143431us
I20260201 09:00:00.733039 17248 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:00.734786 17248 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:00.454619 18851 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:00.457273 18855 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.737314 18851 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:00.640266 18672 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.739566 18672 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 09:00:00.475467 18760 consensus_meta.cc:287] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.953s user 0.002s sys 0.009s
I20260201 09:00:00.740638 18760 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.740991 17174 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:00.741878 18428 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:00.742005 17277 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 09:00:00.742990 18760 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 09:00:00.671790 18743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s user 0.005s sys 0.006s
I20260201 09:00:00.743335 17174 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:00.743760 18743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s user 0.006s sys 0.006s
W20260201 09:00:00.682783 18874 log.cc:927] Time spent T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.055s user 0.001s sys 0.000s
I20260201 09:00:00.730355 18804 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.411481 18695 consensus_queue.cc:260] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.681561 18848 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:00.652007 18362 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.712811 17103 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.745571 18695 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:00.746280 18804 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.747047 18362 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:00.722892 18863 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:00.748381 17793 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:00.748200 18863 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:00.749053 18718 consensus_queue.cc:1175] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f97c64e8acf34ae28a520dd40fc5281c" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 09:00:00.750628 18863 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:00.751080 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 09:00:00.751422 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 43683.9us
I20260201 09:00:00.752017 17848 raft_consensus.cc:2393] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:00.752688 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:00.753647 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.754288 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.756294 18575 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:00.756707 18835 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:00.751691 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:00.756898 18575 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.758198 18569 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:00.759369 18575 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:00.760074 17103 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.760545 18844 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:00.761227 18681 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.762176 18843 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:00.762643 18716 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.763393 18681 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.766480 17276 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:00.767313 17790 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:00.768402 18848 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 09:00:00.769109 18848 raft_consensus.cc:697] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:00.737704 18855 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:00.770355 18848 consensus_queue.cc:237] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.760565 17844 raft_consensus.cc:2393] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:00.749562 17793 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 09:00:00.774188 18825 consensus_meta.cc:287] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.529s user 0.015s sys 0.000s
I20260201 09:00:00.774726 18825 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.781523 18715 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:00.782348 18715 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.785027 18672 raft_consensus.cc:2804] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:00.785362 18846 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:00.785938 18672 raft_consensus.cc:697] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:00.786331 18750 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:00.786880 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:00.787338 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.788203 18862 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:00.789117 17128 raft_consensus.cc:1275] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 09:00:00.789222 18835 raft_consensus.cc:697] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:00.790334 18835 consensus_queue.cc:237] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.791735 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:00.792433 17129 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:00.776324 18716 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:00.809424 18708 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:00.787716 17205 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:00.810114 18708 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:00.812362 18708 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:00.819470 18546 consensus_queue.cc:260] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.821143 18546 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:00.821738 18836 raft_consensus.cc:3055] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:00.822196 18836 raft_consensus.cc:740] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
W20260201 09:00:00.822618 17251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:00.823231 18836 consensus_queue.cc:260] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.823818 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:00.824506 17205 raft_consensus.cc:2468] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 09:00:00.824847 18836 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
W20260201 09:00:00.826318 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 75202.5us
I20260201 09:00:00.830065 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:00.830940 17848 raft_consensus.cc:2368] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:00.830654 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.831128 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.737287 18688 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.833132 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.833758 18672 consensus_queue.cc:237] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.835479 17843 raft_consensus.cc:1240] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:00.839079 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 09:00:00.839273 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 53423.6us
I20260201 09:00:00.839958 17847 raft_consensus.cc:2393] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 6: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:00.840078 17175 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.840425 18716 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 09:00:00.843819 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 129131us
I20260201 09:00:00.853600 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:00.841259 18570 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:00.853660 17129 raft_consensus.cc:2468] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:00.797660 18715 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:00.841184 18716 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:00.866385 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 106431us
I20260201 09:00:00.869081 17202 raft_consensus.cc:2468] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:00.869261 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:00.869874 17844 raft_consensus.cc:1240] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:00.870085 17130 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:00.870915 17210 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:00.869894 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:00.855876 18851 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.884536 17790 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:00.888623 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.889988 17282 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:00.892565 17279 raft_consensus.cc:1275] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:00.893471 18666 consensus_queue.cc:1059] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260201 09:00:00.894382 17794 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.877411 18825 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.898185 18825 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 09:00:00.898988 16955 catalog_manager.cc:5654] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 4, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 4 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:00.878082 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:00.901407 17205 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:00.867183 18362 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:00.901527 16955 catalog_manager.cc:5654] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 2 to 5, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 5 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:00.903551 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:00.904352 17207 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 7.
I20260201 09:00:00.905138 16958 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51048 (request call id 152) took 5774 ms. Trace:
I20260201 09:00:00.905959 18558 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.906863 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.907219 16955 catalog_manager.cc:5654] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 4, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 4 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:00.908309 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:00.902032 18362 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.907822 17790 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:00.862236 18831 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.023s
I20260201 09:00:00.908162 18558 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:00.894707 18666 raft_consensus.cc:3055] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:00.911446 16955 catalog_manager.cc:5654] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:00.903864 18847 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.928416 17249 leader_election.cc:400] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:00.929503 17249 leader_election.cc:403] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260201 09:00:00.921576 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.924517 17793 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:00.919384 18666 raft_consensus.cc:740] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:00.935946 16955 catalog_manager.cc:5654] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 3, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 3 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:00.943758 17279 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:00.946542 17793 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:00.953805 17839 raft_consensus.cc:1240] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
W20260201 09:00:00.939288 18717 consensus_meta.cc:287] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.987s user 0.002s sys 0.012s
I20260201 09:00:00.939249 17846 raft_consensus.cc:1240] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:00.959802 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 09:00:00.960121 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 80853.6us
I20260201 09:00:00.961222 17103 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.962728 18823 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:00.963781 17103 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.964944 18381 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:00.938233 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:00.966827 17793 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:00.966964 18269 consensus_queue.cc:1059] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:00.967839 17793 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:00.965428 18381 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:00.948791 17840 raft_consensus.cc:1240] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:00.984978 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:00.988127 17843 raft_consensus.cc:1240] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:00.955411 18828 raft_consensus.cc:2804] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 09:00:00.989081 18828 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:00.989578 18828 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:00.992302 18659 consensus_queue.cc:1059] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260201 09:00:00.993166 18659 consensus_queue.cc:1243] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer 35484ac93d564e958f85965bd740a18f log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260201 09:00:00.994189 18659 raft_consensus.cc:3055] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 09:00:00.994541 18659 raft_consensus.cc:740] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:00.995452 18659 consensus_queue.cc:260] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:00.955710 18743 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:00.998066 18743 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:00.998275 18675 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:00.982542 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:00.968468 18837 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:00.968242 18269 raft_consensus.cc:3055] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 09:00:00.959687 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.005937 18428 consensus_queue.cc:1059] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:01.006718 18569 consensus_queue.cc:1048] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:00.979597 16955 catalog_manager.cc:5654] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 1 to 4, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 4 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
W20260201 09:00:00.999265 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 120725us
I20260201 09:00:00.968739 18835 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:01.014626 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:00.978586 18381 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:00.978432 18688 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:00.960381 18817 raft_consensus.cc:3060] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:00.988987 18132 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:01.013284 17103 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.031435 18132 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:01.031891 18132 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:01.032450 17103 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:00.969767 18786 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:00.996842 18659 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:01.003526 18750 raft_consensus.cc:2804] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:01.028146 17209 raft_consensus.cc:1275] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 09:00:01.029523 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.033550 17841 raft_consensus.cc:2368] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 09:00:01.004004 18743 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:01.009830 18837 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:01.010363 18269 raft_consensus.cc:740] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:00.968374 18855 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:00.970873 18717 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.015991 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.063709 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.065116 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.066169 18855 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.068156 18750 raft_consensus.cc:697] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:01.069352 18750 consensus_queue.cc:237] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:01.072655 18688 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:01.073004 18832 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:01.073748 18814 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.074030 18688 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:01.074321 18814 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:00.905612 16958 rpcz_store.cc:276] 0201 08:59:55.130269 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:55.130425 (+ 156us) service_pool.cc:225] Handling call
0201 09:00:00.904897 (+5774472us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 08:59:59.445229 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 08:59:59.448767 (+ 3538us) write_op.cc:432] Acquiring schema lock in shared mode
0201 08:59:59.448820 (+ 53us) write_op.cc:435] Acquired schema lock
0201 08:59:59.448836 (+ 16us) tablet.cc:660] Decoding operations
0201 08:59:59.449618 (+ 782us) write_op.cc:620] Acquiring the partition lock for write op
0201 08:59:59.450256 (+ 638us) write_op.cc:641] Partition lock acquired for write op
0201 08:59:59.450290 (+ 34us) tablet.cc:683] Acquiring locks for 6 operations
0201 08:59:59.450779 (+ 489us) tablet.cc:699] Row locks acquired
0201 08:59:59.450795 (+ 16us) write_op.cc:260] PREPARE: finished
0201 08:59:59.450923 (+ 128us) write_op.cc:270] Start()
0201 08:59:59.451036 (+ 113us) write_op.cc:276] Timestamp: P: 1769936399450883 usec, L: 0
0201 08:59:59.451059 (+ 23us) op_driver.cc:348] REPLICATION: starting
0201 08:59:59.451683 (+ 624us) log.cc:844] Serialized 2481 byte log entry
0201 09:00:00.301437 (+849754us) op_driver.cc:464] REPLICATION: finished
0201 09:00:00.305798 (+ 4361us) write_op.cc:301] APPLY: starting
0201 09:00:00.305879 (+ 81us) tablet.cc:1365] starting BulkCheckPresence
0201 09:00:00.412098 (+106219us) tablet.cc:1368] finished BulkCheckPresence
0201 09:00:00.455483 (+ 43385us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 09:00:00.476313 (+ 20830us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 09:00:00.476495 (+ 182us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0201 09:00:00.476534 (+ 39us) write_op.cc:312] APPLY: finished
0201 09:00:00.476772 (+ 238us) log.cc:844] Serialized 52 byte log entry
0201 09:00:00.476972 (+ 200us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:00.477084 (+ 112us) write_op.cc:454] Released schema lock
0201 09:00:00.477133 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0201 09:00:00.477484 (+ 351us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:00.477511 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":142317,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":4099,"apply.run_cpu_time_us":2861,"apply.run_wall_time_us":171690,"num_ops":6,"prepare.queue_time_us":227131,"prepare.run_cpu_time_us":23893,"prepare.run_wall_time_us":98359,"raft.queue_time_us":190368,"raft.run_cpu_time_us":1911,"raft.run_wall_time_us":4426,"replication_time_us":850210,"thread_start_us":391474,"threads_started":4,"wal-append.queue_time_us":109372}]]}
I20260201 09:00:01.076231 18688 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:01.076354 18814 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.046327 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.052969 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260201 09:00:01.078388 18876 log.cc:927] Time spent T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
I20260201 09:00:01.054037 18843 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:01.057413 17103 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.008950 18715 consensus_queue.cc:1059] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260201 09:00:01.081044 17131 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:01.054608 18716 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:01.060622 18558 consensus_queue.cc:1059] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 09:00:01.061161 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.061250 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:01.056388 18837 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:01.062168 18847 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.082917 17249 leader_election.cc:400] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 09:00:01.095026 17249 leader_election.cc:403] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260201 09:00:01.086827 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 50636.7us
I20260201 09:00:01.091038 18699 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:01.091203 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:01.076366 18811 raft_consensus.cc:3060] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:01.093056 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.093281 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:01.055104 18362 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.101135 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:01.102208 18695 raft_consensus.cc:3055] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:01.106117 18695 raft_consensus.cc:740] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:01.106611 17207 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:01.107151 18695 consensus_queue.cc:260] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:01.033161 18666 consensus_queue.cc:260] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.111280 18716 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:01.081185 18717 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.098105 17794 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.118116 18693 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:01.136654 17793 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.081771 18851 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.153956 17174 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:01.156164 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:01.094687 18843 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:01.157069 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.170109 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.173004 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.183243 18825 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260201 09:00:01.195041 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 58484.6us
W20260201 09:00:01.203051 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 67092.1us
W20260201 09:00:01.205989 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 166597us
I20260201 09:00:01.202136 18695 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:01.207052 18569 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:01.220389 17103 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.228205 18569 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:01.257653 17103 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.259327 17103 leader_election.cc:400] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:01.259651 17103 leader_election.cc:403] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 09:00:01.261134 17136 raft_consensus.cc:1275] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 09:00:01.263919 18362 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:01.264846 18362 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:01.266908 18817 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:01.268311 17205 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:01.270824 18837 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.274070 17848 raft_consensus.cc:2368] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:01.274863 18381 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.245823 18855 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:01.287575 18855 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:01.245622 18718 consensus_queue.cc:1048] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260201 09:00:01.282263 18381 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:01.283126 17202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45106 (request call id 214) took 2025 ms (client timeout 1868 ms). Trace:
W20260201 09:00:01.290515 17202 rpcz_store.cc:269] 0201 08:59:59.257846 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:59.257986 (+ 140us) service_pool.cc:225] Handling call
0201 09:00:01.282915 (+2024929us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540025c454. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:01.283050 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2952588544}
I20260201 09:00:01.251504 18843 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:01.285768 17136 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:01.286374 18804 raft_consensus.cc:3055] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:01.326614 17132 raft_consensus.cc:1240] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:01.327854 17128 raft_consensus.cc:1275] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:01.327770 18675 consensus_queue.cc:1059] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:01.253823 18569 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:01.291020 18814 consensus_queue.cc:1048] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:01.329003 18675 raft_consensus.cc:3055] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:01.329345 18675 raft_consensus.cc:740] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:01.330170 18675 consensus_queue.cc:260] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:01.331447 18675 raft_consensus.cc:3060] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:01.331544 18269 consensus_queue.cc:260] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:01.274820 17285 raft_consensus.cc:2468] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:01.326637 18804 raft_consensus.cc:740] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:01.335053 18804 consensus_queue.cc:260] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:01.335393 18828 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.336247 18804 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:01.338179 18828 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.355572 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:01.356217 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:01.305660 18837 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:01.358484 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 115298us
I20260201 09:00:01.332808 18269 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:01.309930 17137 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:01.283746 18132 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:01.309314 17204 raft_consensus.cc:1275] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 09:00:01.310592 17206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 713) took 1071 ms. Trace:
I20260201 09:00:01.324420 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.325174 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.365911 17131 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:01.339305 18855 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:01.279259 18186 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:01.342018 17284 raft_consensus.cc:2468] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:01.342592 18743 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:01.343951 18546 consensus_meta.cc:287] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.522s user 0.013s sys 0.005s
I20260201 09:00:01.351388 18666 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:01.354143 17136 raft_consensus.cc:1240] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:01.354909 17128 raft_consensus.cc:1240] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:01.355110 17132 raft_consensus.cc:1240] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:01.360893 17794 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:01.281026 17279 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 09:00:01.364044 17207 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:01.374827 17135 raft_consensus.cc:1240] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:01.391040 18837 raft_consensus.cc:2804] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:01.391631 18837 raft_consensus.cc:697] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:01.374368 17130 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 8
I20260201 09:00:01.392587 18837 consensus_queue.cc:237] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:01.396276 17281 raft_consensus.cc:1275] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260201 09:00:01.397634 17248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 09:00:01.403237 17248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:01.403820 18186 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:01.405558 17276 raft_consensus.cc:1275] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 09:00:01.406080 18186 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:01.409121 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.411394 18743 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.412164 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:01.412801 17135 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 09:00:01.391830 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36914 (request call id 218) took 1102 ms. Trace:
I20260201 09:00:01.414439 17284 rpcz_store.cc:276] 0201 09:00:00.289680 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:00.290185 (+ 505us) service_pool.cc:225] Handling call
0201 09:00:01.391589 (+1101404us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b540029bdd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:01.391760 (+ 171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2148548480}
I20260201 09:00:01.365247 17206 rpcz_store.cc:276] 0201 09:00:00.238777 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:00.238898 (+ 121us) service_pool.cc:225] Handling call
0201 09:00:00.239219 (+ 321us) raft_consensus.cc:1471] Updating replica for 2 ops
0201 09:00:00.550116 (+310897us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:00.550175 (+ 59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0201 09:00:00.551314 (+ 1139us) log.cc:844] Serialized 52 byte log entry
0201 09:00:00.670590 (+119276us) raft_consensus.cc:1645] Marking committed up to 2
0201 09:00:00.918722 (+248132us) log.cc:844] Serialized 14 byte log entry
0201 09:00:00.926768 (+ 8046us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:01.291082 (+364314us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003075d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:01.291130 (+ 48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:01.291196 (+ 66us) raft_consensus.cc:1685] finished
0201 09:00:01.309890 (+ 18694us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:01.310225 (+ 335us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1156,"prepare.queue_time_us":288567,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":65384,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":9385,"spinlock_wait_cycles":712462080,"thread_start_us":217337,"threads_started":2,"wal-append.queue_time_us":113630}
I20260201 09:00:01.423990 17285 raft_consensus.cc:1275] T c6883c591b5547018eba339947c179ce P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:01.373805 18835 consensus_queue.cc:1048] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260201 09:00:01.431130 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:01.426167 18828 consensus_queue.cc:1048] T 2c4343ae3470408987d247c06337e0a5 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260201 09:00:01.432482 17101 leader_election.cc:400] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:01.437268 17101 leader_election.cc:403] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260201 09:00:01.443830 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 197373us
I20260201 09:00:01.453825 17279 raft_consensus.cc:1275] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:01.453354 17174 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:01.459578 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 72343.6us
I20260201 09:00:01.472687 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:01.473426 17281 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 09:00:01.476336 17177 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:01.490301 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:01.493625 17283 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:01.494204 17132 raft_consensus.cc:1240] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:01.453323 18799 consensus_queue.cc:1048] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260201 09:00:01.476521 18186 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:01.513381 18729 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 09:00:01.516027 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 182927us
W20260201 09:00:01.517697 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 66095.9us
I20260201 09:00:01.518595 17793 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.522199 17177 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:01.527534 17136 raft_consensus.cc:1275] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:01.519737 18681 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:01.506515 18716 raft_consensus.cc:2749] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 09:00:01.531698 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.529955 18695 raft_consensus.cc:2804] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:01.538647 17131 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 7.
I20260201 09:00:01.515369 18823 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.546377 17133 raft_consensus.cc:1275] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:01.547646 17280 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260201 09:00:01.550215 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:01.546650 18843 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:01.551801 18830 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:01.544198 18269 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.553324 18269 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:01.558640 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:01.555542 18269 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:01.591571 17202 raft_consensus.cc:1240] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:01.560109 17284 raft_consensus.cc:1275] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:01.560788 18851 consensus_queue.cc:1048] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:01.562990 18828 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:01.560130 17206 raft_consensus.cc:1240] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:01.552980 18823 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.532198 18785 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.544543 18681 raft_consensus.cc:697] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:01.542021 18132 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.567214 18569 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:01.569185 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.569205 17790 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:01.570932 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.544118 18695 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:01.616750 18695 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:01.617272 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.618590 17130 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 8.
I20260201 09:00:01.619957 17283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36914 (request call id 216) took 1333 ms. Trace:
I20260201 09:00:01.619635 18681 consensus_queue.cc:237] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:01.620329 17283 rpcz_store.cc:276] 0201 09:00:00.286913 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:00.287095 (+ 182us) service_pool.cc:225] Handling call
0201 09:00:01.608789 (+1321694us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54001009d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:01.619892 (+ 11103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2211849472}
I20260201 09:00:01.621727 17283 raft_consensus.cc:1275] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 09:00:01.622982 18785 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.574116 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 09:00:01.623972 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 54847us
I20260201 09:00:01.625110 18785 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.625280 17276 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 09:00:01.627144 18381 consensus_queue.cc:1048] T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:01.629206 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.629613 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.629839 17202 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 09:00:01.630640 18814 consensus_queue.cc:1048] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:01.631034 17210 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:01.632434 17203 raft_consensus.cc:1240] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:01.632691 18835 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.633220 18835 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.635183 18835 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.635926 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:01.636335 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 09:00:01.576121 17251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:01.637431 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.638092 17210 raft_consensus.cc:2393] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 6: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:01.638757 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.639878 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.640275 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.640596 17206 raft_consensus.cc:2368] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:01.577013 17285 raft_consensus.cc:1275] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:01.578025 17248 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 09:00:01.642675 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 64803.5us
I20260201 09:00:01.643201 18269 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:01.514093 18729 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:01.598438 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 75430.8us
I20260201 09:00:01.645124 18729 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.645257 17793 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:01.645141 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:01.599836 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:01.623973 17282 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:01.613291 18837 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.613782 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.614580 18823 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.572985 17209 raft_consensus.cc:1240] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:01.643492 17248 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.629122 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.651407 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.632283 18814 raft_consensus.cc:2804] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:01.651131 17790 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 09:00:01.645874 18907 log.cc:927] Time spent T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.055s user 0.000s sys 0.000s
I20260201 09:00:01.656955 17278 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:01.651684 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.601480 18828 consensus_queue.cc:1243] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer 3dee892ea94d4f2a92316ad6f79edca2 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260201 09:00:01.670819 17207 raft_consensus.cc:1240] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260201 09:00:01.671692 18569 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.672806 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:01.673313 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:01.673149 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:01.666947 17210 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:01.660100 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.663373 18837 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.668145 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:01.677532 17848 raft_consensus.cc:2393] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:01.677733 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.679514 17282 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 7.
I20260201 09:00:01.679853 17211 raft_consensus.cc:2368] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 09:00:01.663180 18743 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:01.689507 17133 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 09:00:01.683346 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.690719 17209 raft_consensus.cc:3060] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:01.687400 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:01.610242 18847 consensus_queue.cc:1048] T ef3dae7e71e447b79f434ce7b1684707 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260201 09:00:01.692819 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.691300 17839 raft_consensus.cc:2468] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 1.
I20260201 09:00:01.695840 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:01.693548 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 09:00:01.698015 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 46963.4us
I20260201 09:00:01.699251 17790 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:01.702142 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:01.705319 17175 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:01.709245 18848 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:01.709717 18848 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.710076 18848 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:01.678869 18851 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260201 09:00:01.689459 18675 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:01.714998 17248 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.717573 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.723204 17136 raft_consensus.cc:1275] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 09:00:01.728209 18837 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.709290 18900 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:01.729053 17202 raft_consensus.cc:2393] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:01.704574 18830 consensus_queue.cc:1048] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260201 09:00:01.730677 18186 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:01.730824 18848 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.731650 17204 raft_consensus.cc:1240] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:01.706614 18750 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Leader election won for term 8
I20260201 09:00:01.697507 18814 raft_consensus.cc:697] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [term 7 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:01.718336 17210 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 8.
I20260201 09:00:01.733924 17209 raft_consensus.cc:2468] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 7.
I20260201 09:00:01.733472 17133 pending_rounds.cc:85] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 1
I20260201 09:00:01.745960 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.732372 18750 raft_consensus.cc:697] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 8 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:01.745014 18843 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.747210 18843 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:01.747519 18750 consensus_queue.cc:237] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.713971 18743 raft_consensus.cc:697] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:01.749558 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.741948 17133 pending_rounds.cc:107] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260201 09:00:01.751283 17133 raft_consensus.cc:2889] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:01.751799 17202 raft_consensus.cc:2368] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:01.759212 17136 raft_consensus.cc:1275] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 09:00:01.769049 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.770210 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.770860 17211 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:01.772046 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.777107 17209 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85"
dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:45104
I20260201 09:00:01.777794 17209 raft_consensus.cc:606] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 09:00:01.778115 17209 raft_consensus.cc:614] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 09:00:01.742198 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:01.785296 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 09:00:01.786980 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 93383.4us
I20260201 09:00:01.785144 18828 consensus_queue.cc:1048] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:01.787858 17248 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.789708 17202 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260201 09:00:01.787137 17137 raft_consensus.cc:2468] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 1.
I20260201 09:00:01.735958 18695 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:01.793053 18695 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:01.790844 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.749504 18675 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:01.794909 18716 consensus_queue.cc:1059] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:01.795336 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.795917 18716 raft_consensus.cc:3055] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:01.796326 18716 raft_consensus.cc:740] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:01.794001 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.797235 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.790913 17794 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:01.801035 17790 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:01.800544 17250 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:01.803920 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:01.809521 17202 raft_consensus.cc:1240] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:01.742389 18835 consensus_queue.cc:1048] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260201 09:00:01.742659 18830 consensus_queue.cc:1048] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260201 09:00:01.741245 18381 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260201 09:00:01.809747 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:01.819293 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.820071 17136 raft_consensus.cc:2393] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 6: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:01.819293 17250 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.823268 17793 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.828208 17101 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:01.829308 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.830443 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.830986 17102 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.831478 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.831908 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:01.833029 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:01.834455 18695 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:01.835016 18695 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.828974 18814 consensus_queue.cc:237] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:01.804807 18811 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:01.837170 18843 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:01.814620 18715 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:01.837903 18715 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:01.838279 18715 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:01.832043 17136 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:01.795706 18675 consensus_queue.cc:1059] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260201 09:00:01.843888 17278 raft_consensus.cc:1275] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 09:00:01.849664 17250 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:01.837497 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 09:00:01.832065 18912 log.cc:927] Time spent T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.127s user 0.001s sys 0.000s
I20260201 09:00:01.813114 18659 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:01.842686 18820 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 09:00:01.855531 18848 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:01.852658 18785 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:01.876453 17839 raft_consensus.cc:1240] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:01.853546 18695 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:01.878790 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:01.856097 18799 raft_consensus.cc:2804] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 09:00:01.855907 18910 raft_consensus.cc:2804] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 09:00:01.863271 18811 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260201 09:00:01.896181 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 95211.6us
I20260201 09:00:01.884032 18659 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:01.903012 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 78575.2us
I20260201 09:00:01.886442 18815 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:01.885474 18910 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.894767 18909 raft_consensus.cc:2764] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260201 09:00:01.884961 18799 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:01.865411 18716 consensus_queue.cc:260] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:01.910804 18659 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:01.907390 18811 consensus_queue.cc:1059] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260201 09:00:01.952790 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 48211.8us
W20260201 09:00:01.987377 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 137639us
I20260201 09:00:01.989501 17250 leader_election.cc:400] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:01.883080 18743 consensus_queue.cc:237] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:01.989878 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 148766us
I20260201 09:00:01.913008 18910 raft_consensus.cc:3060] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
W20260201 09:00:02.001377 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 92219.4us
W20260201 09:00:02.003455 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 163888us
I20260201 09:00:01.958366 18799 raft_consensus.cc:3060] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:02.009869 17205 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:02.010561 17277 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 09:00:02.011480 18659 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:02.012887 18920 log.cc:927] Time spent T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
I20260201 09:00:02.013706 18716 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:01.997839 18815 raft_consensus.cc:697] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 7 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:02.015172 18921 consensus_queue.cc:1048] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:02.003096 18811 consensus_queue.cc:1243] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer 3dee892ea94d4f2a92316ad6f79edca2 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260201 09:00:01.990769 18785 consensus_queue.cc:1059] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260201 09:00:02.019945 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:02.021200 18914 log.cc:927] Time spent T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.117s user 0.001s sys 0.000s
I20260201 09:00:02.022135 17284 raft_consensus.cc:1275] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:02.026677 18851 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 09:00:02.036370 18931 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:02.027607 18848 consensus_queue.cc:1059] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:02.039047 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 09:00:02.004510 18906 log.cc:927] Time spent T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.370s user 0.000s sys 0.008s
W20260201 09:00:02.016167 18908 log.cc:927] Time spent T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.142s user 0.000s sys 0.000s
I20260201 09:00:02.072257 17847 raft_consensus.cc:1240] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
W20260201 09:00:02.072737 18913 log.cc:927] Time spent T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.125s user 0.000s sys 0.000s
I20260201 09:00:02.026672 18799 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:02.031517 17136 raft_consensus.cc:2468] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:02.081954 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 09:00:02.069864 18915 log.cc:927] Time spent T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.076s user 0.000s sys 0.001s
I20260201 09:00:02.068994 18362 consensus_queue.cc:1059] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260201 09:00:02.095484 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:02.096316 18815 consensus_queue.cc:237] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.098402 18823 consensus_queue.cc:1059] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:02.109901 18362 raft_consensus.cc:3055] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:02.110352 18362 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:02.111230 18799 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:02.111132 18362 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:02.112304 18715 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.079061 18851 consensus_queue.cc:1048] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260201 09:00:02.114672 17284 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:02.118703 17843 raft_consensus.cc:1240] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:02.121274 18546 raft_consensus.cc:3055] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:02.121677 18546 raft_consensus.cc:740] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:02.122491 18546 consensus_queue.cc:260] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:02.123869 18546 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:02.127815 18715 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:02.134287 18814 raft_consensus.cc:3055] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:02.134766 18814 raft_consensus.cc:740] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:02.135608 18814 consensus_queue.cc:260] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.079818 17846 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
W20260201 09:00:02.140642 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 110104us
I20260201 09:00:02.112521 18362 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:02.141587 17250 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:02.146399 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:02.147311 18695 consensus_queue.cc:1059] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:02.162452 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:02.162817 18695 raft_consensus.cc:3055] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:02.148423 18681 consensus_queue.cc:1059] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:02.152791 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:02.073626 18811 consensus_queue.cc:1059] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260201 09:00:02.155942 17249 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:02.147606 17209 raft_consensus.cc:1275] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 09:00:02.163725 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 45225.6us
I20260201 09:00:02.138605 18814 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
W20260201 09:00:02.185174 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 43678.6us
I20260201 09:00:02.186050 17250 leader_election.cc:400] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 09:00:02.105726 18675 consensus_queue.cc:1059] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260201 09:00:02.165117 18695 raft_consensus.cc:740] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 09:00:02.216236 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 96335us
I20260201 09:00:02.193245 18715 raft_consensus.cc:3055] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:02.199047 17250 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:02.199672 18932 consensus_queue.cc:1059] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:02.201417 17248 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:02.205113 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 130371us
I20260201 09:00:02.187669 18729 raft_consensus.cc:3055] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:02.187317 18931 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:02.187425 18269 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:02.187950 18381 consensus_queue.cc:1048] T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260201 09:00:02.212397 18910 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:02.254163 18931 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:02.187781 18934 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260201 09:00:02.293642 18931 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:02.219303 18715 raft_consensus.cc:740] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:02.294188 18659 consensus_queue.cc:1059] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:02.295187 18715 consensus_queue.cc:260] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:02.296463 18715 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:02.309105 18695 consensus_queue.cc:260] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:02.318956 17102 leader_election.cc:400] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:02.251956 18729 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:02.320485 17102 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:02.253661 18843 consensus_queue.cc:1059] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260201 09:00:02.359884 17128 raft_consensus.cc:1240] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
W20260201 09:00:02.374079 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 205264us
I20260201 09:00:02.362843 18937 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:02.316713 18931 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:02.377950 18930 raft_consensus.cc:3055] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:02.387398 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:02.380544 18930 raft_consensus.cc:740] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
W20260201 09:00:02.405476 18897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s user 0.002s sys 0.007s
I20260201 09:00:02.406694 18186 raft_consensus.cc:3055] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Stepping down as leader of term 1
I20260201 09:00:02.409935 18693 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
W20260201 09:00:02.430989 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 242672us
I20260201 09:00:02.428807 18362 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:02.376368 18729 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:02.433389 18909 raft_consensus.cc:3055] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:02.437693 18909 raft_consensus.cc:740] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:02.438581 18909 consensus_queue.cc:260] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:02.439805 18909 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:02.441947 18729 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:02.382622 18937 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:02.447592 18937 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:02.449091 18930 consensus_queue.cc:260] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:02.450920 18930 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:02.457828 18910 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:02.483915 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 284933us
W20260201 09:00:02.419158 18897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s user 0.002s sys 0.007s
I20260201 09:00:02.498138 18716 raft_consensus.cc:2764] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260201 09:00:02.433020 18902 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:02.477345 17790 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:02.429152 18186 raft_consensus.cc:740] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:02.511029 17790 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:02.514056 18941 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260201 09:00:02.524312 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:02.486011 18362 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:02.531646 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 09:00:02.539654 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 338292us
W20260201 09:00:02.539757 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 09:00:02.541446 17250 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:02.540570 17248 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:02.545753 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 225317us
I20260201 09:00:02.547077 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:02.547888 17839 raft_consensus.cc:2393] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:02.546576 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:02.465366 18693 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.512763 18814 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:02.532702 18362 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:02.543262 18716 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:02.581612 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:02.554919 18938 raft_consensus.cc:3055] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:02.503228 18902 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.553921 18675 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:02.583637 17278 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260201 09:00:02.595515 17174 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:02.596771 17174 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.603037 17250 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:02.579231 18269 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:02.581878 18934 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:02.612367 17174 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.614650 17248 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:02.585790 18938 raft_consensus.cc:740] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:02.607503 18716 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260201 09:00:02.635499 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:02.607542 18501 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:02.639998 17174 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.591202 18937 consensus_queue.cc:1059] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260201 09:00:02.644945 18681 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 09:00:02.620710 18855 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:02.648488 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.580287 18186 consensus_queue.cc:260] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:02.607890 18675 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:02.650470 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:02.650059 17174 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.620087 18269 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.652143 18716 consensus_queue.cc:1059] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:02.637081 18957 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:02.660521 17174 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.639503 18934 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260201 09:00:02.663165 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 09:00:02.662006 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 45852.6us
I20260201 09:00:02.664588 17177 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.644187 18931 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:02.667888 17174 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.649914 18681 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 09:00:02.653914 18855 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:02.672091 17103 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.662988 18501 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:02.667356 18186 raft_consensus.cc:3060] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:02.693768 17103 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.665256 18934 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:02.696156 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:02.695153 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 09:00:02.701905 18962 log.cc:927] Time spent T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260201 09:00:02.702333 18902 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:02.695621 18934 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:02.703282 18269 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:02.703649 18675 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:02.707687 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:02.708328 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:02.708461 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:02.708886 18693 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 09:00:02.710819 18954 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.065s user 0.001s sys 0.000s
I20260201 09:00:02.712821 17129 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260201 09:00:02.713209 18681 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:02.708918 17839 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:02.713243 17129 pending_rounds.cc:85] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 2
I20260201 09:00:02.714191 17129 pending_rounds.cc:107] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260201 09:00:02.714422 17129 raft_consensus.cc:2889] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:02.708426 17843 raft_consensus.cc:2393] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:02.712414 17278 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:02.713529 18953 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:02.715850 17103 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.717547 18855 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:02.718525 18953 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 09:00:02.707985 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:02.719125 17847 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 09:00:02.719401 17103 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.720536 17278 raft_consensus.cc:606] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 09:00:02.723208 17278 raft_consensus.cc:614] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 09:00:02.726780 17249 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:02.728065 17103 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.729665 17285 raft_consensus.cc:2393] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:02.692150 18909 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:02.715790 18823 raft_consensus.cc:3055] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 09:00:02.731806 18937 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:02.730229 18953 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:02.741164 17103 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.742108 18909 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:02.742614 17130 raft_consensus.cc:1275] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:02.736155 18937 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:02.733858 18823 raft_consensus.cc:740] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:02.729491 18970 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:02.745465 18953 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
W20260201 09:00:02.743886 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 103029us
I20260201 09:00:02.745894 17103 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:02.752228 17847 raft_consensus.cc:1240] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:02.753768 17284 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:02.754376 17284 raft_consensus.cc:606] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 09:00:02.754848 17284 raft_consensus.cc:614] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 09:00:02.754277 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:02.756603 17843 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 09:00:02.759399 17135 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260201 09:00:02.746372 18937 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:02.759354 18968 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:02.762781 18847 consensus_queue.cc:1059] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:02.753298 18851 consensus_queue.cc:1048] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260201 09:00:02.774510 18847 raft_consensus.cc:3055] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:02.774896 18847 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
W20260201 09:00:02.776156 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 102226us
I20260201 09:00:02.783284 17174 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.785302 17174 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:02.786370 17284 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:02.786973 17284 raft_consensus.cc:606] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 09:00:02.787343 17284 raft_consensus.cc:614] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260201 09:00:02.788444 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260201 09:00:02.788959 17174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:02.789798 18902 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:02.790115 17130 raft_consensus.cc:1240] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260201 09:00:02.790369 18902 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:02.790486 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:02.791550 17131 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:02.792311 18902 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:02.775691 18847 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.793663 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:02.794106 17205 raft_consensus.cc:1240] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:02.795012 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:02.795533 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:02.795074 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:02.792932 18855 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:02.792619 17134 raft_consensus.cc:1240] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:02.798069 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:02.796696 17209 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 09:00:02.800205 17248 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:02.800236 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:02.802953 18269 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:02.803362 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:02.803962 17134 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 09:00:02.804064 18930 consensus_queue.cc:1059] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:02.796121 17203 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:02.805397 17205 raft_consensus.cc:1275] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260201 09:00:02.812562 17175 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:02.799751 18675 consensus_queue.cc:1059] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260201 09:00:02.814251 17135 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 09:00:02.814525 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:02.822649 17209 raft_consensus.cc:2393] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:02.804169 17208 raft_consensus.cc:1275] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:02.782696 18968 raft_consensus.cc:697] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:02.760454 18934 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:02.820391 18835 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:02.786819 18970 raft_consensus.cc:2804] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:02.843519 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:02.847393 18953 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:02.848174 18972 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.063s
I20260201 09:00:02.836597 18928 consensus_queue.cc:1059] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260201 09:00:02.833310 18931 consensus_queue.cc:1059] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260201 09:00:02.851999 18947 consensus_queue.cc:1048] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 09:00:02.856995 18835 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:02.859087 18835 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:02.828581 17209 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f"
dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
mode: GRACEFUL
new_leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
from {username='slave'} at 127.0.0.1:45104
I20260201 09:00:02.830804 17174 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 09:00:02.832799 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 168276us
I20260201 09:00:02.837857 17102 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:02.840014 17281 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:02.799894 18681 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:02.841815 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:02.813733 18855 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.796521 18823 consensus_queue.cc:260] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:02.842854 18934 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:02.875675 17839 raft_consensus.cc:2468] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:02.866580 17202 raft_consensus.cc:2468] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
W20260201 09:00:02.883970 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 46229us
I20260201 09:00:02.885317 17249 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:02.893497 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:02.894717 17211 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:02.894981 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:02.882153 18186 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:02.883118 18785 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:02.889593 18953 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:02.894551 18931 raft_consensus.cc:2804] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:02.907972 17793 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:02.903360 18186 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:02.888978 18902 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260201 09:00:02.891403 18937 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.861398 18968 consensus_queue.cc:237] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:02.905627 18953 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:02.905774 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:02.928450 17133 raft_consensus.cc:1240] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:02.936424 17209 raft_consensus.cc:606] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Received request to transfer leadership to TS 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:02.938237 18938 consensus_queue.cc:260] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:02.939543 18938 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:02.919716 18976 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:02.940600 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:02.941241 17843 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 4
I20260201 09:00:02.941154 18976 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:02.903921 18539 consensus_queue.cc:1048] T b057fd1bf2ef435ab6dcce60b1e45e10 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260201 09:00:02.918463 18931 raft_consensus.cc:697] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [term 6 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:02.922051 18186 raft_consensus.cc:3060] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
W20260201 09:00:02.946744 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 116006us
I20260201 09:00:02.943879 18937 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:02.942006 18953 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:02.923285 18362 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:02.924263 18799 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:03.039987 17277 raft_consensus.cc:2368] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4.
I20260201 09:00:02.941722 18969 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:02.947371 18715 raft_consensus.cc:3055] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:03.113189 18969 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:03.113252 18715 raft_consensus.cc:740] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:03.113685 18969 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.114362 18715 consensus_queue.cc:260] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.115871 18715 raft_consensus.cc:3060] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.117139 18957 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.117637 18957 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:03.119688 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:03.119977 18743 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.120087 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260201 09:00:03.120472 18743 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.122129 17128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 701) took 1291 ms. Trace:
I20260201 09:00:03.122390 18743 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:02.907214 18785 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.125326 18928 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:03.125929 18928 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.127988 18928 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:03.130059 18785 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 09:00:03.070103 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:03.080138 18269 consensus_queue.cc:1059] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260201 09:00:03.136898 18984 raft_consensus.cc:993] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: : Instructing follower 3dee892ea94d4f2a92316ad6f79edca2 to start an election
I20260201 09:00:03.137388 18984 raft_consensus.cc:1081] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Signalling peer 3dee892ea94d4f2a92316ad6f79edca2 to start an election
W20260201 09:00:03.074432 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 114563us
W20260201 09:00:03.073480 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 260973us
I20260201 09:00:03.138792 17128 rpcz_store.cc:276] 0201 09:00:01.830549 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:01.903515 (+ 72966us) service_pool.cc:225] Handling call
0201 09:00:02.003055 (+ 99540us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:02.375691 (+372636us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:03.121865 (+746174us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54005de3d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:03.122050 (+ 185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":799527168}
I20260201 09:00:03.079568 17209 raft_consensus.cc:1240] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:03.090715 18362 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:03.083740 18980 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260201 09:00:03.086465 18979 log.cc:927] Time spent T c6883c591b5547018eba339947c179ce P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.160s user 0.001s sys 0.000s
I20260201 09:00:03.090507 18695 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:03.149457 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.097776 18953 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.099545 18811 raft_consensus.cc:3055] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Stepping down as leader of term 1
I20260201 09:00:03.161947 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.119628 18957 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.100351 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:03.101054 18855 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.110558 18976 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.140373 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.147358 17250 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:03.150758 17843 raft_consensus.cc:2468] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:03.221828 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.159780 17208 raft_consensus.cc:2393] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:03.222525 17281 raft_consensus.cc:2468] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 09:00:03.160924 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:03.157011 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 09:00:03.099782 18978 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.181809 17210 raft_consensus.cc:2393] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
W20260201 09:00:03.210100 17249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:03.146757 18569 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:03.227435 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 306610us
W20260201 09:00:03.159740 18982 log.cc:927] Time spent T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.133s user 0.001s sys 0.000s
I20260201 09:00:03.232434 17248 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:03.149045 18928 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:03.238560 17102 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:03.235584 17103 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 09:00:03.236245 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 54722.4us
W20260201 09:00:03.238150 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 90879us
I20260201 09:00:03.171005 18811 raft_consensus.cc:740] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:03.169683 18934 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 09:00:03.275620 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 392769us
I20260201 09:00:03.230484 18937 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.153803 18186 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.160230 17130 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f"
dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
from {username='slave'} at 127.0.0.1:46082
I20260201 09:00:03.283108 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.284206 17210 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:03.237229 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.240604 18930 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 09:00:03.279237 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.305581 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.236370 18501 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:03.276821 18956 raft_consensus.cc:2804] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:03.243336 18716 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:03.275278 18957 raft_consensus.cc:2804] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:03.305634 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.299233 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.236106 18569 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.236485 18978 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.277130 18942 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:03.306355 17843 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 09:00:03.327207 17204 raft_consensus.cc:2393] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:03.328248 17208 raft_consensus.cc:1240] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []
I20260201 09:00:03.306561 17130 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260201 09:00:03.267798 18928 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.312031 18546 raft_consensus.cc:3055] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:03.374305 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.297873 18902 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:03.287626 18970 raft_consensus.cc:697] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:03.326411 18956 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:03.330879 18716 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:03.284971 18934 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.290901 18937 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.356827 17210 raft_consensus.cc:1275] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:03.311730 17132 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:03.333536 17284 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 09:00:03.375042 17281 raft_consensus.cc:2393] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:03.320691 18501 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:03.388813 17131 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
W20260201 09:00:03.373677 18973 log.cc:927] Time spent T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260201 09:00:03.289762 18931 consensus_queue.cc:237] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:03.392648 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 473579us
I20260201 09:00:03.372849 17130 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:03.412710 17207 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:03.413214 17209 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
W20260201 09:00:03.394801 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 62895.4us
I20260201 09:00:03.374017 18546 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:03.391454 18716 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:03.386905 18956 raft_consensus.cc:3060] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:03.428158 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:03.384265 18957 raft_consensus.cc:697] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:03.425856 18675 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.447189 18934 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.448643 18937 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:03.424803 18659 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:03.449330 18659 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.450624 17794 leader_election.cc:400] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4.
I20260201 09:00:03.450981 17794 leader_election.cc:403] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260201 09:00:03.451332 18659 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:03.451987 18546 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.453271 18546 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.454584 18501 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:03.455232 18926 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:03.455600 18871 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4.
I20260201 09:00:03.455947 18928 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:03.386270 18902 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.462894 18902 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.461448 18978 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.330582 18811 consensus_queue.cc:260] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.382951 18942 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.470432 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.470580 17211 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:03.471928 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.475297 17281 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 09:00:03.488401 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.493520 17249 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.494804 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.495481 17207 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:03.490288 17281 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:03.495872 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:03.473300 18269 consensus_queue.cc:1175] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260201 09:00:03.469436 18953 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.497675 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.546108 17282 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 09:00:03.546981 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.547628 17282 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 09:00:03.512838 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.496881 17843 raft_consensus.cc:2393] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
W20260201 09:00:03.549533 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 116435us
I20260201 09:00:03.478725 17102 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:03.443885 18969 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.493335 18811 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:03.551242 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.447414 18675 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.551312 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.553990 17281 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 6: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:03.552680 17250 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.560317 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 09:00:03.561396 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 82748.1us
I20260201 09:00:03.564342 17177 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 09:00:03.551395 18982 log.cc:927] Time spent T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260201 09:00:03.566525 17177 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.546868 18938 raft_consensus.cc:2804] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:03.528653 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.587981 17210 raft_consensus.cc:2368] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:03.461419 18957 consensus_queue.cc:237] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:03.568084 17282 raft_consensus.cc:1275] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:03.571252 18695 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:03.575333 18716 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.578222 17130 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.555135 18835 raft_consensus.cc:476] T 457eeb0a14cc4d28823521cfef13996e P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Not starting pre-election -- already a leader
I20260201 09:00:03.545276 18186 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.567528 18909 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election won for term 4
W20260201 09:00:03.582875 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:03.565940 18980 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.580564 18942 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 09:00:03.596834 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 104330us
I20260201 09:00:03.569182 18928 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:03.587438 18985 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:03.589993 18569 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.591771 18695 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 09:00:03.602572 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:03.601423 17278 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
W20260201 09:00:03.597735 18990 log.cc:927] Time spent T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.261s user 0.001s sys 0.000s
W20260201 09:00:03.597532 18987 log.cc:927] Time spent T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.095s user 0.000s sys 0.001s
I20260201 09:00:03.590587 18546 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:03.608173 18909 raft_consensus.cc:697] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:03.608896 17133 raft_consensus.cc:1240] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:03.616254 17843 raft_consensus.cc:1275] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:03.609676 17248 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:03.545475 18970 consensus_queue.cc:237] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.599323 18928 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:03.618613 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.603984 18985 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:03.594931 17276 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 09:00:03.593215 18938 raft_consensus.cc:697] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:03.619585 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.617669 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.600204 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.621140 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.622037 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:03.621155 17281 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:03.610411 18695 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:03.629901 17794 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.629952 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:03.623492 18902 consensus_queue.cc:1059] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260201 09:00:03.631657 17282 raft_consensus.cc:1275] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:03.632323 18955 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:03.633316 18998 log.cc:927] Time spent T 85f87e31da9e48ee853c4246adc1a1a2 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260201 09:00:03.622644 18928 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:03.639977 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.639389 17248 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:03.645421 17277 raft_consensus.cc:2393] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:03.615288 18947 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.647418 17129 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:03.655120 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.637643 18675 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:03.623893 18985 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.599483 18980 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:03.630599 18931 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:03.655853 17204 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:03.640625 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.661940 18847 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
W20260201 09:00:03.662385 19000 log.cc:927] Time spent T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260201 09:00:03.662919 18909 consensus_queue.cc:237] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:03.663404 18926 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:03.666086 17175 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:03.676968 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.667371 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.669699 17250 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.670504 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:03.677938 17204 raft_consensus.cc:3055] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:03.677987 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:03.666020 17280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 265) took 1659 ms. Trace:
I20260201 09:00:03.677670 17839 raft_consensus.cc:2393] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:03.620613 18546 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.674295 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:03.679806 17133 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.680577 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.680644 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.681717 18675 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:03.674723 17205 raft_consensus.cc:2393] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:03.696256 17848 raft_consensus.cc:2393] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:03.662959 17130 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.678303 17204 raft_consensus.cc:740] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:03.678725 17280 rpcz_store.cc:276] 0201 09:00:02.006585 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:02.006716 (+ 131us) service_pool.cc:225] Handling call
0201 09:00:02.035390 (+ 28674us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:02.062548 (+ 27158us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:02.062579 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:02.074464 (+ 11885us) log.cc:844] Serialized 26 byte log entry
0201 09:00:02.924395 (+849931us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b18001482a0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab 00007f74afdd90c3 00007f74afdd9471 00007f74b01f573f
0201 09:00:03.219821 (+295426us) raft_consensus.cc:1645] Marking committed up to 1
0201 09:00:03.219867 (+ 46us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:03.219936 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:03.665715 (+445779us) raft_consensus.cc:1685] finished
0201 09:00:03.665734 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:03.665948 (+ 214us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":47692,"raft.queue_time_us":50250,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":11547,"spinlock_wait_cycles":75008896,"thread_start_us":230438,"threads_started":1,"wal-append.queue_time_us":1337443}
I20260201 09:00:03.700057 17794 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:03.671654 18931 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:03.704494 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:03.683022 18675 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:03.681064 18855 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:03.676770 18926 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:03.682017 18999 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:03.659853 18947 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:03.705451 19001 log.cc:927] Time spent T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
I20260201 09:00:03.653355 18955 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.707091 17204 consensus_queue.cc:260] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.702752 18931 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:03.723775 18989 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260201 09:00:03.724107 18957 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:03.737346 17101 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:03.712324 18926 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.735028 17103 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:03.707787 18675 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:03.710045 18855 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:03.739212 17847 raft_consensus.cc:2393] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
W20260201 09:00:03.720777 19009 log.cc:927] Time spent T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260201 09:00:03.682180 18950 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
I20260201 09:00:03.708580 18969 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.742714 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.745879 17281 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 09:00:03.745121 17285 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:03.746141 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:03.746704 17280 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
W20260201 09:00:03.736558 19004 log.cc:927] Time spent T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.066s user 0.001s sys 0.000s
I20260201 09:00:03.751327 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.749009 18837 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260201 09:00:03.730363 18955 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.726776 18716 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.754074 17207 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 09:00:03.731827 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:03.759526 18820 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:03.700456 18938 consensus_queue.cc:237] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.737149 18815 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260201 09:00:03.740231 18828 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:03.743110 18855 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.777897 18828 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:03.749019 19006 consensus_queue.cc:1048] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260201 09:00:03.778353 18828 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:03.762420 19003 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:03.753033 18823 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:03.780575 18820 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.780269 18501 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:03.783727 18501 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.786561 17276 raft_consensus.cc:3060] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.754652 18942 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:03.795182 18947 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:03.799937 18695 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.803514 18820 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:03.803835 17794 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.805351 18501 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:03.809739 18546 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.810540 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.811218 17284 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:03.812165 18980 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:03.812994 18848 raft_consensus.cc:2804] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:03.813421 18848 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:03.813771 18949 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:03.815435 17794 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.817091 18830 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:03.817458 18830 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:03.817785 18830 raft_consensus.cc:3060] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.742763 18957 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:03.822278 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.836910 17133 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:03.813735 18848 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 09:00:03.866302 19010 log.cc:927] Time spent T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.101s user 0.000s sys 0.000s
I20260201 09:00:03.866441 19003 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.866977 19003 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.867231 17846 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 09:00:03.867679 18957 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:03.868920 19003 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.871012 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.871785 17848 raft_consensus.cc:2393] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:03.820513 18942 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:03.872192 18942 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:03.863829 17202 raft_consensus.cc:1240] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260201 09:00:03.872462 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 317043us
I20260201 09:00:03.874053 17249 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:03.871587 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.875146 17131 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 3.
I20260201 09:00:03.875161 17249 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:03.878587 18999 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:03.879768 18999 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:03.882500 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:03.883200 17848 raft_consensus.cc:2393] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:03.883438 18675 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:03.886477 17840 raft_consensus.cc:1275] T fe590c5ab6064559bcc7599baa5667c5 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:03.889688 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:03.896731 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:03.897414 18695 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:03.898663 18830 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.899029 19006 consensus_queue.cc:1048] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:03.760406 18956 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:03.904348 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 143249us
I20260201 09:00:03.906083 17280 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:03.909955 17103 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.910645 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:03.911285 17282 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:03.912942 17102 leader_election.cc:400] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:03.913309 17102 leader_election.cc:403] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 09:00:03.917048 17174 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:03.817876 18985 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:03.922858 17174 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:03.897468 18546 consensus_queue.cc:1048] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260201 09:00:03.922962 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.927235 17210 raft_consensus.cc:2393] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:03.928823 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:03.929448 17134 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:03.925412 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:03.917328 19006 raft_consensus.cc:2804] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:03.950536 17282 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 7.
I20260201 09:00:03.935568 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.945492 18830 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:03.915122 19003 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:03.969055 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:03.974807 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:03.978685 17133 raft_consensus.cc:2393] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:03.930462 18994 raft_consensus.cc:2804] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:03.981956 17175 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:03.982782 17136 raft_consensus.cc:2468] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 09:00:03.948717 19006 raft_consensus.cc:697] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:03.987910 17177 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:03.949878 18980 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:03.931398 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.000103 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:03.946806 18848 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.000694 17211 raft_consensus.cc:3060] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:03.925722 18828 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:03.974506 18501 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:03.986748 18871 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.020372 18871 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:04.022527 18871 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:04.003831 17282 raft_consensus.cc:2468] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:03.997822 18695 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:04.023394 18695 raft_consensus.cc:697] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:04.024235 18695 consensus_queue.cc:237] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.005339 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.026578 17210 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:03.998020 18569 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:04.029582 18569 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:04.029969 18569 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:04.030170 18855 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.031316 17206 raft_consensus.cc:2368] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 09:00:04.032173 18855 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.032989 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.033618 17282 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.034061 18848 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.993634 18902 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.035001 18902 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.001462 18675 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:03.998749 18994 raft_consensus.cc:697] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:03.997944 18980 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.038245 18980 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.038556 18994 consensus_queue.cc:237] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.017940 18985 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.019615 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.041297 17844 raft_consensus.cc:1240] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 09:00:04.042074 18828 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:04.042707 18501 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.043850 18926 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.044695 18501 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:03.983814 17276 raft_consensus.cc:2468] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.005869 17203 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:04.047653 17282 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.055125 17277 raft_consensus.cc:1240] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260201 09:00:04.055536 18928 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.059041 17278 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.060022 17177 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:04.048772 17211 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:04.045507 17839 raft_consensus.cc:2368] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:04.059113 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.049288 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.062227 17281 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 4
I20260201 09:00:04.063083 17250 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.036916 18902 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.053238 17841 raft_consensus.cc:2393] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:04.058307 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:04.069756 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:04.069988 17794 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.070487 17210 raft_consensus.cc:2393] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:04.076339 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.077944 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.080623 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:04.069507 17276 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 09:00:04.085583 17102 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:04.088811 17177 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.092545 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:04.092149 17284 raft_consensus.cc:2468] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 09:00:04.093330 17137 raft_consensus.cc:2393] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:04.089322 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:04.053226 18956 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:04.094099 17103 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.097222 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:04.069526 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.070703 18681 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:04.070101 18546 raft_consensus.cc:2804] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:04.102190 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:04.111074 17843 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.111318 17204 raft_consensus.cc:3060] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:04.103250 17177 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.107241 17278 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.116777 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:04.101166 18823 raft_consensus.cc:2804] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 09:00:04.097693 18996 raft_consensus.cc:2804] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:04.097508 18501 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:04.117048 17790 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:04.100535 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:04.104954 17130 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 09:00:04.125056 17793 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:04.110412 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:04.055176 19006 consensus_queue.cc:237] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.101195 19003 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:04.125852 18743 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:04.105612 18928 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.138111 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:04.140017 18927 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:04.118474 18855 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:04.163771 18855 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.164170 18855 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.114233 18967 consensus_queue.cc:1059] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260201 09:00:04.168506 18967 raft_consensus.cc:3055] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:04.169927 18931 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.172032 18931 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:04.172801 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:04.173228 18926 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:04.139329 18501 raft_consensus.cc:697] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:04.174641 18501 consensus_queue.cc:237] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.145500 18675 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:04.177229 18675 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.179198 18675 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.180060 18942 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.181653 17205 raft_consensus.cc:2368] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 09:00:04.144972 19003 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.185698 19003 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:04.187417 18835 consensus_queue.cc:1059] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:04.161103 18381 raft_consensus.cc:3055] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:04.189296 18381 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:04.189636 17177 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.189869 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:04.190069 18381 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:04.190518 17840 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 09:00:04.191174 18381 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:04.137398 18996 raft_consensus.cc:697] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:04.144129 18823 raft_consensus.cc:697] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:04.193362 18996 consensus_queue.cc:237] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:04.193656 18823 consensus_queue.cc:237] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.196779 17249 leader_election.cc:400] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:04.197180 17249 leader_election.cc:403] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260201 09:00:04.147795 17204 raft_consensus.cc:2468] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:04.150840 17134 raft_consensus.cc:2468] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:04.147289 17843 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.119169 18546 raft_consensus.cc:697] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:04.200208 17250 leader_election.cc:400] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 09:00:04.201627 17278 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:04.218427 17250 leader_election.cc:403] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 09:00:03.432003 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 09:00:04.219691 17250 leader_election.cc:400] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 09:00:04.219997 17250 leader_election.cc:403] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 09:00:04.191023 18985 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:04.198361 18967 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:04.221094 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.221383 18967 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.221871 18931 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 09:00:04.222716 18967 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:04.221776 18952 consensus_queue.cc:1059] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260201 09:00:04.221751 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:04.234797 17281 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:04.233610 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.243673 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:04.235124 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:04.159915 18927 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.263638 17278 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260201 09:00:04.264078 17278 pending_rounds.cc:85] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Aborting all ops after (but not including) 2
W20260201 09:00:04.228974 18984 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260201 09:00:04.264290 17278 pending_rounds.cc:107] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260201 09:00:04.264700 17278 raft_consensus.cc:2889] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:04.272809 17794 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.276408 17174 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:04.242075 18675 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:04.198688 18569 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.244951 18985 raft_consensus.cc:697] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:04.262825 18716 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5.
I20260201 09:00:04.266094 18927 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.262528 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 09:00:04.278743 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 148897us
I20260201 09:00:04.261117 18938 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:04.284296 17845 raft_consensus.cc:1275] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:04.277994 17276 raft_consensus.cc:2393] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:04.274273 18999 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:04.300357 17205 raft_consensus.cc:2393] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:04.303473 19003 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.291922 17128 raft_consensus.cc:1275] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:04.304955 16955 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51072 (request call id 139) took 10236 ms. Trace:
I20260201 09:00:04.281843 18994 raft_consensus.cc:2804] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260201 09:00:04.288260 17203 raft_consensus.cc:1275] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260201 09:00:04.309725 19003 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:04.310186 18994 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:04.322592 18994 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Advancing to term 2
I20260201 09:00:04.312656 18969 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260201 09:00:04.325915 18569 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.314363 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:04.326907 17205 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:04.288235 18546 consensus_queue.cc:237] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.300181 18926 raft_consensus.cc:2804] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:04.354573 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.355626 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:04.356402 17204 raft_consensus.cc:2393] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:04.360240 17130 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:04.361735 17248 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.362969 18994 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:04.367587 17128 raft_consensus.cc:3060] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:04.368980 18994 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:04.305330 16955 rpcz_store.cc:276] 0201 08:59:54.069055 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:54.109577 (+ 40522us) service_pool.cc:225] Handling call
0201 09:00:04.304842 (+10195265us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 09:00:01.530338 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 09:00:01.552959 (+ 22621us) write_op.cc:432] Acquiring schema lock in shared mode
0201 09:00:01.553008 (+ 49us) write_op.cc:435] Acquired schema lock
0201 09:00:01.553025 (+ 17us) tablet.cc:660] Decoding operations
0201 09:00:01.553972 (+ 947us) write_op.cc:620] Acquiring the partition lock for write op
0201 09:00:01.554089 (+ 117us) write_op.cc:641] Partition lock acquired for write op
0201 09:00:01.554122 (+ 33us) tablet.cc:683] Acquiring locks for 6 operations
0201 09:00:01.554780 (+ 658us) tablet.cc:699] Row locks acquired
0201 09:00:01.554799 (+ 19us) write_op.cc:260] PREPARE: finished
0201 09:00:01.554972 (+ 173us) write_op.cc:270] Start()
0201 09:00:01.555148 (+ 176us) write_op.cc:276] Timestamp: P: 1769936401554901 usec, L: 0
0201 09:00:01.555182 (+ 34us) op_driver.cc:348] REPLICATION: starting
0201 09:00:01.615461 (+ 60279us) log.cc:844] Serialized 2481 byte log entry
0201 09:00:02.266309 (+650848us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74ad16ef0c 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab
0201 09:00:02.645080 (+378771us) op_driver.cc:464] REPLICATION: finished
0201 09:00:02.742987 (+ 97907us) write_op.cc:301] APPLY: starting
0201 09:00:02.743083 (+ 96us) tablet.cc:1365] starting BulkCheckPresence
0201 09:00:02.743272 (+ 189us) tablet.cc:1368] finished BulkCheckPresence
0201 09:00:02.743311 (+ 39us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 09:00:02.762646 (+ 19335us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 09:00:02.762904 (+ 258us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0201 09:00:02.762968 (+ 64us) write_op.cc:312] APPLY: finished
0201 09:00:02.763280 (+ 312us) log.cc:844] Serialized 52 byte log entry
0201 09:00:02.763472 (+ 192us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:02.763587 (+ 115us) write_op.cc:454] Released schema lock
0201 09:00:02.763642 (+ 55us) write_op.cc:341] FINISH: Updating metrics
0201 09:00:02.775523 (+ 11881us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:02.775555 (+ 32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":99387,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":92349,"apply.run_cpu_time_us":2887,"apply.run_wall_time_us":32510,"num_ops":6,"prepare.queue_time_us":277153,"prepare.run_cpu_time_us":14273,"prepare.run_wall_time_us":1017046,"raft.queue_time_us":91807,"raft.run_cpu_time_us":12284,"raft.run_wall_time_us":49286,"replication_time_us":1089737,"spinlock_wait_cycles":84659968,"thread_start_us":1087988,"threads_started":4,"wal-append.queue_time_us":887823,"wal-append.run_cpu_time_us":7058,"wal-append.run_wall_time_us":1251831}]]}
I20260201 09:00:04.374545 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.375221 17210 raft_consensus.cc:2468] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 09:00:04.306882 16957 catalog_manager.cc:5654] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 4, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:04.383486 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.384116 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:04.327073 18942 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:04.364332 18999 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.377015 18675 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:04.396090 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:04.404359 17210 raft_consensus.cc:3060] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:04.321498 18980 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:04.400254 16957 catalog_manager.cc:5654] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 6, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 6 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:04.405948 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:04.409029 17844 raft_consensus.cc:2393] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 2: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:04.410354 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:04.417820 17845 raft_consensus.cc:1275] T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:04.418306 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:04.407979 17175 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:04.353801 18909 consensus_queue.cc:1048] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260201 09:00:04.353577 18938 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.398180 18996 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.419302 17279 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:04.390357 18926 raft_consensus.cc:697] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:04.435042 16957 catalog_manager.cc:5654] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 5, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 5 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:04.421854 17175 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:04.459578 17103 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:04.450423 18675 raft_consensus.cc:697] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:04.429661 17211 raft_consensus.cc:1275] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:04.426899 17842 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 6.
I20260201 09:00:04.444914 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.398026 18969 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:04.447499 17210 raft_consensus.cc:2468] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:04.448598 17128 raft_consensus.cc:1275] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:04.451014 17202 raft_consensus.cc:2368] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:04.456224 17130 raft_consensus.cc:2468] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 09:00:04.465813 17281 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 6
I20260201 09:00:04.464470 17277 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 6: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:04.426736 18695 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:04.475692 17281 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:04.458040 19003 raft_consensus.cc:3055] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:04.408142 18999 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.477643 16957 catalog_manager.cc:5654] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 09:00:04.498734 16957 catalog_manager.cc:5654] T 6af74496ca1949d78f5a2a08f5cb9635 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 4, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 4 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:04.500478 18902 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:04.501120 16957 catalog_manager.cc:5654] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 3 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:04.502764 18938 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:04.477946 18969 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.502745 16957 catalog_manager.cc:5654] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:04.491915 17843 raft_consensus.cc:1240] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 09:00:04.493801 18855 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.494874 18927 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:04.496201 17174 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:04.510494 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.511931 17130 raft_consensus.cc:2368] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
W20260201 09:00:04.496970 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 75244us
I20260201 09:00:04.497529 19003 raft_consensus.cc:740] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:04.483425 18926 consensus_queue.cc:237] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.520692 19003 consensus_queue.cc:260] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:04.522197 19003 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:04.517957 17175 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:04.505213 18969 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.401242 18985 consensus_queue.cc:237] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.468683 18996 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:04.429520 18984 consensus_queue.cc:1048] T c35836a4583949f3b2ac7cbef2205db2 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260201 09:00:04.461452 18675 consensus_queue.cc:237] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.510783 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.533473 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.513566 17210 raft_consensus.cc:1275] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:04.469485 18823 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:04.516391 17248 leader_election.cc:400] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 09:00:04.536810 17248 leader_election.cc:403] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260201 09:00:04.536998 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.429457 18716 consensus_queue.cc:1048] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260201 09:00:04.528359 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:04.458014 18968 consensus_queue.cc:1048] T a3beb95bbbb64b4485bc29a00f4c7854 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260201 09:00:04.535787 17847 raft_consensus.cc:1240] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:04.547992 18928 consensus_queue.cc:1048] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:04.524964 18938 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.540249 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:04.515868 18999 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:04.524358 18501 raft_consensus.cc:2804] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader election won for term 2
I20260201 09:00:04.542352 18996 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:04.538939 19036 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 5. Current term is 6.
I20260201 09:00:04.539283 18953 consensus_queue.cc:1048] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260201 09:00:04.565443 18855 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:04.530478 18569 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:04.569000 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:04.569583 17130 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.546449 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.547477 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:04.477092 18931 consensus_queue.cc:1048] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260201 09:00:04.558789 18501 raft_consensus.cc:697] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:04.559321 18980 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:04.557984 18938 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.563598 17205 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:04.544066 18927 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:04.569700 16957 catalog_manager.cc:5654] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f reported cstate change: term changed from 1 to 3, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 3 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:04.553552 18823 raft_consensus.cc:697] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:04.573649 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:04.582676 17843 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.574965 17848 raft_consensus.cc:2410] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260201 09:00:04.574805 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:04.571700 19036 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.574743 18569 raft_consensus.cc:697] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:04.584173 17137 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.587893 19036 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.590114 19036 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:04.590832 17102 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:04.592298 18953 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:04.592531 18823 consensus_queue.cc:237] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.593077 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
W20260201 09:00:04.597555 19039 log.cc:927] Time spent T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.091s user 0.000s sys 0.002s
I20260201 09:00:04.600452 17278 raft_consensus.cc:1275] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 09:00:04.601830 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:04.602437 17841 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:04.602942 18938 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:04.603381 19031 log.cc:927] Time spent T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.116s user 0.000s sys 0.001s
I20260201 09:00:04.604223 18501 consensus_queue.cc:237] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:04.606902 19033 log.cc:927] Time spent T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.125s user 0.000s sys 0.003s
I20260201 09:00:04.610270 18569 consensus_queue.cc:237] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:04.611074 17202 raft_consensus.cc:1275] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:04.611904 17102 leader_election.cc:400] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:04.622125 17102 leader_election.cc:403] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260201 09:00:04.614732 17845 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260201 09:00:04.622870 17845 pending_rounds.cc:85] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Aborting all ops after (but not including) 3
I20260201 09:00:04.623093 17845 pending_rounds.cc:107] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260201 09:00:04.623289 17845 raft_consensus.cc:2889] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:04.616071 17249 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.608294 17793 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:04.625208 17137 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.597301 18909 consensus_queue.cc:1059] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:04.625301 17793 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:04.611148 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 76437.9us
I20260201 09:00:04.633888 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.634475 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:04.635680 17174 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:04.638264 18946 consensus_queue.cc:1048] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260201 09:00:04.638978 17276 raft_consensus.cc:1275] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:04.641181 18681 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:04.644454 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:04.645114 17280 raft_consensus.cc:3060] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.634578 17137 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 09:00:04.650569 17248 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.648399 17250 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:04.627526 17130 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.655598 17843 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.656024 17280 raft_consensus.cc:2468] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:04.656684 17278 raft_consensus.cc:1275] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:04.657755 17128 raft_consensus.cc:1275] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:04.647579 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.649943 18362 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.663611 18362 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:04.664371 19030 log.cc:927] Time spent T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.183s user 0.002s sys 0.000s
I20260201 09:00:04.663266 18985 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.665221 18985 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.666381 18589 raft_consensus.cc:2804] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:04.666772 18589 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.667186 18362 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:04.658934 18968 raft_consensus.cc:2749] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911) with higher term. Message: Invalid argument: T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:04.667088 18589 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:04.671144 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.647586 18955 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:04.650473 18980 raft_consensus.cc:2804] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:04.667676 18942 consensus_queue.cc:1048] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:04.681845 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:04.650538 18953 raft_consensus.cc:697] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:04.648815 19043 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:04.667635 18985 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 09:00:04.694016 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 56115.6us
I20260201 09:00:04.672395 18938 raft_consensus.cc:2804] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:04.670064 18958 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:04.678953 18695 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.671048 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.698592 17278 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
I20260201 09:00:04.701615 18953 consensus_queue.cc:237] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.675599 18969 consensus_queue.cc:1048] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260201 09:00:04.702932 18958 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:04.696709 19043 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.711287 19043 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:04.676537 18681 consensus_queue.cc:1048] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260201 09:00:04.693564 18811 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:04.699230 18980 raft_consensus.cc:697] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:04.738974 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:04.709415 18938 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.752342 17277 raft_consensus.cc:1275] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 09:00:04.754135 17793 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:04.755637 17793 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 09:00:04.760277 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 112826us
I20260201 09:00:04.761181 17174 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:04.712512 18695 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.748111 18938 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:04.750850 18855 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.775861 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.776674 17137 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 4.
I20260201 09:00:04.777426 17128 raft_consensus.cc:1275] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 09:00:04.778208 17174 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:04.784482 19045 log.cc:927] Time spent T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260201 09:00:04.787551 18993 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:04.788005 18993 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:04.788339 18993 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:04.760670 18977 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:04.795053 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:04.769043 18871 consensus_queue.cc:1048] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260201 09:00:04.796957 18980 consensus_queue.cc:237] T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.767354 18984 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:04.789960 17277 raft_consensus.cc:1275] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:04.768778 18972 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260201 09:00:04.820598 19044 log.cc:927] Time spent T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.137s user 0.001s sys 0.000s
W20260201 09:00:04.819059 19047 log.cc:927] Time spent T 9dd88f5c612b4e5985855eee079c4716 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.095s user 0.002s sys 0.000s
I20260201 09:00:04.771314 18985 consensus_queue.cc:1048] T 8f36c29f280a42faa270584136681eda P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260201 09:00:04.781455 18855 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:04.845389 17845 raft_consensus.cc:1275] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:04.811076 18902 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260201 09:00:04.918423 17202 raft_consensus.cc:1275] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260201 09:00:04.811498 17205 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
W20260201 09:00:04.923806 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 85896.5us
I20260201 09:00:04.835304 18815 consensus_queue.cc:1048] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.093s
I20260201 09:00:04.837118 18984 raft_consensus.cc:697] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:04.934158 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:04.838442 19003 consensus_queue.cc:1048] T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260201 09:00:04.937182 17277 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
W20260201 09:00:04.927675 19042 log.cc:927] Time spent T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.244s user 0.000s sys 0.001s
I20260201 09:00:04.925104 18952 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:04.942704 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 151960us
I20260201 09:00:04.942348 17794 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:04.943583 18958 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:04.968468 17845 raft_consensus.cc:1240] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260201 09:00:04.938997 18815 consensus_queue.cc:1243] T 3d4bbc7074224d289f38153d63a1c181 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer 3dee892ea94d4f2a92316ad6f79edca2 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260201 09:00:04.938470 18589 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:05.000362 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:05.001317 17137 raft_consensus.cc:2393] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:04.965175 18970 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:04.967016 18814 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:05.010176 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:05.011727 17130 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 2.
I20260201 09:00:04.948244 18952 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:05.020012 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 09:00:05.023878 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 67107.4us
I20260201 09:00:05.028122 17208 raft_consensus.cc:1275] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:05.030120 17130 raft_consensus.cc:1275] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:05.006534 18695 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.008217 18814 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:05.034987 17130 raft_consensus.cc:1275] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260201 09:00:05.027915 19051 log.cc:927] Time spent T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.202s user 0.000s sys 0.001s
W20260201 09:00:05.032047 19050 log.cc:927] Time spent T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.206s user 0.001s sys 0.000s
I20260201 09:00:05.006429 18970 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:05.090862 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 52559.7us
I20260201 09:00:05.010424 19053 consensus_queue.cc:1048] T 9bad6ae52daf4b8bba5e450dbee00fe0 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260201 09:00:05.091975 19057 log.cc:927] Time spent T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.130s user 0.000s sys 0.000s
I20260201 09:00:05.093237 18589 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:05.097433 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:04.997004 18984 consensus_queue.cc:237] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:05.105258 18931 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:05.033630 19003 consensus_queue.cc:1059] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260201 09:00:05.045025 18814 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:05.035365 18675 consensus_queue.cc:1048] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260201 09:00:05.106104 18970 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.107722 17284 raft_consensus.cc:1275] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:05.110194 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:05.035626 18928 consensus_queue.cc:1048] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260201 09:00:05.117517 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:05.122412 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:05.126577 17282 raft_consensus.cc:2410] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260201 09:00:05.107635 18952 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.154222 17279 raft_consensus.cc:1275] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:05.155737 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:05.156407 17282 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:05.156761 18956 raft_consensus.cc:3055] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:05.157202 18956 raft_consensus.cc:740] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:05.158000 18956 consensus_queue.cc:260] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:05.159212 18956 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:05.159667 17177 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:05.161381 18695 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:05.161731 18695 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:05.162065 18695 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:05.162212 19043 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:05.164233 19043 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:05.152761 18855 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.159715 19035 consensus_queue.cc:1048] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260201 09:00:05.173295 17280 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260201 09:00:05.150420 19056 log.cc:927] Time spent T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.233s user 0.001s sys 0.000s
I20260201 09:00:05.212462 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:05.213260 17130 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:05.215557 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:05.216655 19036 consensus_queue.cc:1048] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
W20260201 09:00:05.225039 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 179632us
W20260201 09:00:05.225277 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 106436us
I20260201 09:00:05.129573 18931 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:05.227259 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:05.252694 17103 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:05.254833 17207 raft_consensus.cc:1275] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:05.250801 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:05.256690 17845 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:05.262261 17130 raft_consensus.cc:2468] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 09:00:05.177626 19035 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260201 09:00:05.227118 18938 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:05.295367 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 266228us
I20260201 09:00:05.265575 19053 raft_consensus.cc:2804] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:05.301091 17845 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:05.256024 19003 consensus_queue.cc:1048] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260201 09:00:05.305279 19053 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:05.306535 18952 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.358155 17285 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 6. Current term is 7. Ops: []
W20260201 09:00:05.360015 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 123219us
I20260201 09:00:05.361573 17249 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:05.363620 19035 consensus_queue.cc:1059] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:05.364518 18994 raft_consensus.cc:3055] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:05.364903 18994 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:05.365677 18994 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:05.366819 18994 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:05.336668 19053 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:05.353845 18695 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:05.353557 18952 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:05.396739 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 09:00:05.403296 17847 raft_consensus.cc:1275] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:05.403541 17843 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 6. Current term is 7. Ops: []
W20260201 09:00:05.407495 19070 log.cc:927] Time spent T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.123s user 0.001s sys 0.000s
I20260201 09:00:05.384624 19043 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:05.307418 19060 consensus_queue.cc:1048] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260201 09:00:05.414261 18931 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:05.456359 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 53616.8us
I20260201 09:00:05.460613 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:05.461298 17845 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:05.423890 19043 raft_consensus.cc:697] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:05.462617 17249 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:05.470775 17282 raft_consensus.cc:1275] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260201 09:00:05.458285 19071 log.cc:927] Time spent T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.154s user 0.001s sys 0.000s
I20260201 09:00:05.476727 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:05.479143 19087 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:05.479615 19087 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:05.479935 19087 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
W20260201 09:00:05.481403 19059 log.cc:927] Time spent T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.477s user 0.000s sys 0.010s
I20260201 09:00:05.480552 18814 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:05.483469 18993 consensus_meta.cc:287] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.664s user 0.008s sys 0.001s
W20260201 09:00:05.486088 19058 log.cc:927] Time spent T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.475s user 0.000s sys 0.001s
I20260201 09:00:05.486467 18814 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:05.482244 19043 consensus_queue.cc:237] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:05.480571 19078 log.cc:927] Time spent T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.098s user 0.000s sys 0.000s
W20260201 09:00:05.516822 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 144901us
I20260201 09:00:05.483870 18993 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:05.528668 18695 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.531419 19053 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:05.533979 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:05.514787 18871 consensus_queue.cc:1048] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260201 09:00:05.537650 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:05.538286 17129 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 09:00:05.540875 17210 raft_consensus.cc:1240] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:05.542002 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:05.625655 19053 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.626753 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:05.627519 17282 raft_consensus.cc:2393] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:05.629417 19087 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:05.630838 17278 raft_consensus.cc:2368] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:05.570593 18952 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 09:00:05.674306 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 213430us
I20260201 09:00:05.677057 19094 consensus_queue.cc:1048] T 68c080f2c06d4219bdb2e4a546153bc4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260201 09:00:05.684127 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:05.684960 17845 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
W20260201 09:00:05.686455 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 243103us
W20260201 09:00:05.685055 19097 log.cc:927] Time spent T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.068s user 0.001s sys 0.000s
I20260201 09:00:05.688639 17101 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:05.693526 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:05.698580 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 09:00:05.690550 19031 log.cc:927] Time spent T c7a634ccefb24b158e97cff94318758f P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.121s user 0.000s sys 0.009s
I20260201 09:00:05.704659 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:05.696017 19053 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:05.720804 17284 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:05.708953 19099 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:05.722450 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
W20260201 09:00:05.722016 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 231195us
W20260201 09:00:05.729058 18956 consensus_meta.cc:287] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.566s user 0.011s sys 0.001s
I20260201 09:00:05.739074 19087 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:05.745749 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:05.745757 17276 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:05.749527 17794 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:05.794716 17847 raft_consensus.cc:1240] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:05.795390 17284 raft_consensus.cc:606] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 09:00:05.795853 17284 raft_consensus.cc:614] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260201 09:00:05.801055 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 62774.4us
I20260201 09:00:05.743744 19099 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.745877 18993 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.746899 19087 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:05.796840 19092 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election won for term 5
W20260201 09:00:05.862725 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 58491.7us
I20260201 09:00:05.806135 19101 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.857167 18675 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.852882 19099 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:05.861852 18956 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.862818 18952 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.945381 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:05.862599 18909 raft_consensus.cc:493] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:05.894861 19092 raft_consensus.cc:697] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:05.858089 19087 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:05.953446 18931 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.898134 19101 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:05.945392 18675 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:05.959288 18909 raft_consensus.cc:515] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:05.981838 19111 log.cc:927] Time spent T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.119s user 0.000s sys 0.000s
I20260201 09:00:05.982398 18909 leader_election.cc:290] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:05.976356 18931 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:05.987990 18931 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:05.988516 18931 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:05.956419 18956 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:05.956205 18952 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:05.990288 18675 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:05.964982 18985 raft_consensus.cc:493] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:05.961961 19092 consensus_queue.cc:237] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:05.997957 17176 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:05.999737 18956 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:06.004511 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 212817us
I20260201 09:00:06.013895 18938 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:06.013816 18952 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:06.003334 18675 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.046516 18823 raft_consensus.cc:493] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.314011 19006 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.314683 19006 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:06.328608 19006 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:06.059446 19035 consensus_queue.cc:1048] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.160s
I20260201 09:00:06.333582 19087 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:06.004834 18985 raft_consensus.cc:515] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:05.997390 18931 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.338932 18823 raft_consensus.cc:515] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.467975 18823 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:06.469631 19006 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.470172 19006 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.472070 19006 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:06.477205 18985 leader_election.cc:290] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:06.314373 19101 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:06.491237 17251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s user 0.019s sys 0.022s
W20260201 09:00:06.491673 17251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s user 0.019s sys 0.022s
I20260201 09:00:06.405229 19087 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:06.507817 17790 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.044s user 0.018s sys 0.016s
W20260201 09:00:06.508325 17790 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.045s user 0.018s sys 0.016s
W20260201 09:00:06.505990 19065 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.714s user 0.008s sys 0.025s
I20260201 09:00:06.262208 18675 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:06.490952 19101 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:06.495931 18811 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.521458 18675 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 09:00:06.515590 19065 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.765s user 0.008s sys 0.026s
W20260201 09:00:06.529794 17793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s user 0.027s sys 0.079s
W20260201 09:00:06.532101 17793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s user 0.027s sys 0.079s
I20260201 09:00:06.540243 19112 raft_consensus.cc:493] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.527384 18985 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.511546 19087 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.550343 18967 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:06.529575 19101 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:06.556360 18828 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.556114 19116 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:06.540831 18811 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:06.579041 17791 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s user 0.131s sys 0.200s
W20260201 09:00:06.583930 17791 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s user 0.131s sys 0.200s
W20260201 09:00:06.589881 17102 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s user 0.020s sys 0.022s
W20260201 09:00:06.591310 17102 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s user 0.020s sys 0.022s
I20260201 09:00:06.593551 18835 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.602276 19101 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:06.571710 18985 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:06.592368 19116 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.603507 18814 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
W20260201 09:00:06.604671 19099 consensus_meta.cc:287] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.652s user 0.008s sys 0.000s
I20260201 09:00:06.605221 18931 leader_election.cc:290] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:06.606772 18811 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:06.549732 19112 raft_consensus.cc:515] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:06.610626 17204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s user 0.013s sys 0.025s
I20260201 09:00:06.584345 18967 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:06.618844 17206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 758) took 2003 ms. Trace:
W20260201 09:00:06.624828 17280 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s user 0.000s sys 0.014s
W20260201 09:00:06.614842 18957 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s user 0.003s sys 0.014s
I20260201 09:00:06.592515 18828 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:06.638132 17280 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s user 0.001s sys 0.014s
I20260201 09:00:06.638028 17206 rpcz_store.cc:276] 0201 09:00:04.614970 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:04.615114 (+ 144us) service_pool.cc:225] Handling call
0201 09:00:04.615406 (+ 292us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:04.615761 (+ 355us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:04.615791 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:04.621332 (+ 5541us) log.cc:844] Serialized 26 byte log entry
0201 09:00:04.686050 (+ 64718us) raft_consensus.cc:1645] Marking committed up to 1
0201 09:00:04.686092 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:04.686160 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:06.602202 (+1916042us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b2400498308. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74acfe0ad4 00007f74acfdebdb 00007f74ad06dad9 00007f74ad06d765 00007f74ad06ccc0 00007f74afe01828 00007f74afe01f88 00007f74afdd9738 00007f74afdd4b0a 00007f74afdd3f56
0201 09:00:06.611099 (+ 8897us) raft_consensus.cc:1685] finished
0201 09:00:06.611122 (+ 23us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:06.618771 (+ 7649us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":19900,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":16092416,"thread_start_us":55236,"threads_started":1,"wal-append.queue_time_us":134302}
W20260201 09:00:06.638039 17204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s user 0.014s sys 0.025s
W20260201 09:00:06.640988 17248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s user 0.009s sys 0.008s
W20260201 09:00:06.642632 17248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s user 0.009s sys 0.008s
W20260201 09:00:06.641187 19043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s user 0.006s sys 0.012s
W20260201 09:00:06.639200 18957 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s user 0.004s sys 0.014s
I20260201 09:00:06.634470 18362 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:06.649396 18909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s user 0.009s sys 0.008s
I20260201 09:00:06.639912 18946 raft_consensus.cc:493] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:06.649880 17100 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.682s user 0.014s sys 0.044s
I20260201 09:00:06.652153 19116 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:06.633140 18835 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:06.636197 18814 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:06.658284 18967 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:06.646967 19043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s user 0.006s sys 0.012s
I20260201 09:00:06.677568 19101 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.637359 19099 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.683115 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 09:00:06.682272 17842 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s user 0.010s sys 0.014s
W20260201 09:00:06.685330 17175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s user 0.003s sys 0.015s
W20260201 09:00:06.829977 17842 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.806s user 0.010s sys 0.014s
W20260201 09:00:06.830075 17175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s user 0.003s sys 0.015s
W20260201 09:00:06.688526 17177 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s user 0.018s sys 0.047s
W20260201 09:00:06.831214 17177 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s user 0.019s sys 0.047s
W20260201 09:00:06.681479 17100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s user 0.015s sys 0.044s
I20260201 09:00:06.677762 18931 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.677417 18362 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.694177 19087 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:06.759941 17284 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55128 (request call id 3) took 1034 ms. Trace:
I20260201 09:00:06.684648 18946 raft_consensus.cc:515] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.679702 18823 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.801667 19112 leader_election.cc:290] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:06.801632 17794 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.007s user 0.020s sys 0.042s
I20260201 09:00:06.802996 18828 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:06.803189 18811 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:06.804904 17174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.860s user 0.012s sys 0.020s
I20260201 09:00:06.848047 19053 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.874941 17129 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:06.875217 19053 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.875612 19132 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.876178 19132 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:06.805398 18957 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:06.808182 19062 log.cc:927] Time spent T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 1.772s user 0.005s sys 0.020s
I20260201 09:00:06.877367 19053 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:06.877915 19053 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 09:00:06.810807 19052 log.cc:927] Time spent T a3beb95bbbb64b4485bc29a00f4c7854 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 1.818s user 0.003s sys 0.034s
I20260201 09:00:06.810683 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:06.878227 19132 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:06.860210 18956 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.878664 19079 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:06.878899 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 761) took 2112 ms. Trace:
W20260201 09:00:06.680296 18909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s user 0.009s sys 0.009s
W20260201 09:00:06.819205 17101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.827s user 0.011s sys 0.019s
W20260201 09:00:06.879452 17101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s user 0.011s sys 0.019s
I20260201 09:00:06.879192 19079 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:06.880836 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:06.862128 19006 raft_consensus.cc:493] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:06.841449 19003 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
W20260201 09:00:06.874624 17174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.929s user 0.012s sys 0.020s
I20260201 09:00:06.873718 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:06.884173 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 941259us
I20260201 09:00:06.884781 17174 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:06.826790 17103 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s user 0.015s sys 0.010s
I20260201 09:00:06.841871 17284 rpcz_store.cc:276] 0201 09:00:05.720330 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:05.720626 (+ 296us) service_pool.cc:225] Handling call
0201 09:00:06.754770 (+1034144us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b540052bcd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b02344d3 00007f74b51f213a 00007f74ae78d934 00007f74ae78d8c2 00007f74ae78d7f1 00007f74ae78d76c 00007f74ae78ca22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:06.754918 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":154831104}
I20260201 09:00:06.845650 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:06.856390 17794 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s user 0.020s sys 0.042s
I20260201 09:00:06.680094 19124 raft_consensus.cc:493] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:06.887972 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 1.09346e+06us
W20260201 09:00:06.827023 18980 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.733s user 0.008s sys 0.020s
I20260201 09:00:06.877136 18957 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:06.887326 17103 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s user 0.015s sys 0.010s
W20260201 09:00:06.826404 18953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.810s user 0.007s sys 0.038s
I20260201 09:00:06.860421 17790 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:06.883853 17206 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:06.884665 17211 rpcz_store.cc:276] 0201 09:00:04.766155 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:04.766275 (+ 120us) service_pool.cc:225] Handling call
0201 09:00:04.776199 (+ 9924us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:04.776472 (+ 273us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:04.776490 (+ 18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:04.796432 (+ 19942us) log.cc:844] Serialized 26 byte log entry
0201 09:00:04.945510 (+149078us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:04.945554 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:04.945624 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:06.807595 (+1861971us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 09:00:06.878566 (+ 70971us) raft_consensus.cc:1685] finished
0201 09:00:06.878590 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:06.878824 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":78,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":17858944,"thread_start_us":124860,"threads_started":1,"wal-append.queue_time_us":178360}
W20260201 09:00:06.882619 19080 log.cc:927] Time spent T 00000000000000000000000000000000 P 0d9a3591250040b0b07d71f8a9f3dd4c: Append to log took a long time: real 1.524s user 0.012s sys 0.009s
I20260201 09:00:06.821396 18993 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.873557 19099 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:06.982955 17793 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:06.882720 19003 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:06.874229 18946 leader_election.cc:290] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.004756 18926 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:07.005254 18926 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:07.004987 18976 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:07.005743 18946 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:07.005822 18976 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.006569 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:06.982159 19079 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:07.005673 18926 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:07.008160 18976 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:06.878343 19053 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:06.912812 18828 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.872831 18362 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:06.882620 19006 raft_consensus.cc:515] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:06.913652 18814 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.048763 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 330) took 1296 ms. Trace:
I20260201 09:00:06.874392 18835 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.005976 19093 raft_consensus.cc:2804] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader election won for term 3
I20260201 09:00:06.905294 18909 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.904170 19112 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.893944 18811 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:06.861877 18823 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:06.916345 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:06.916613 19127 raft_consensus.cc:493] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.874624 19061 raft_consensus.cc:493] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.917044 17844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39018 (request call id 666) took 2322 ms. Trace:
I20260201 09:00:06.882807 18956 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:06.842474 19101 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:06.918948 18968 raft_consensus.cc:493] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.141709 18968 raft_consensus.cc:515] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.142647 18811 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.132308 19138 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.143576 18968 leader_election.cc:290] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.144061 18968 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:06.922994 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 09:00:06.931347 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 80730.4us
I20260201 09:00:06.932042 17284 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "35484ac93d564e958f85965bd740a18f"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:07.146427 17284 raft_consensus.cc:606] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Received request to transfer leadership to TS 35484ac93d564e958f85965bd740a18f
I20260201 09:00:07.146785 17284 raft_consensus.cc:614] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 09:00:06.934981 17129 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:07.147562 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.147910 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:06.983126 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:06.983342 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.061714 18362 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.149459 17279 raft_consensus.cc:2410] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 09:00:07.149786 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:07.150339 19131 log.cc:927] Time spent T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.089s user 0.000s sys 0.000s
W20260201 09:00:06.981393 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 96686us
W20260201 09:00:06.999022 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 67718.1us
W20260201 09:00:06.982076 18953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.968s user 0.007s sys 0.041s
I20260201 09:00:07.150782 18823 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.118285 19003 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:06.894508 19132 raft_consensus.cc:493] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.012761 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 09:00:06.952934 18980 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.859s user 0.009s sys 0.020s
I20260201 09:00:07.009984 18985 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:07.046288 18828 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.047861 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:06.859927 18931 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.001576 18969 raft_consensus.cc:2804] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:07.057348 17204 rpcz_store.cc:276] 0201 09:00:05.752718 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:05.798329 (+ 45611us) service_pool.cc:225] Handling call
0201 09:00:05.798680 (+ 351us) raft_consensus.cc:1471] Updating replica for 2 ops
0201 09:00:05.830981 (+ 32301us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:05.831015 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0201 09:00:05.857041 (+ 26026us) log.cc:844] Serialized 52 byte log entry
0201 09:00:06.640771 (+783730us) raft_consensus.cc:1645] Marking committed up to 1
0201 09:00:06.640814 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:06.641092 (+ 278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:07.048507 (+407415us) raft_consensus.cc:1685] finished
0201 09:00:07.048528 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:07.048698 (+ 170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1468,"raft.queue_time_us":61356,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":79004,"thread_start_us":699306,"threads_started":1,"wal-append.queue_time_us":1181161}
I20260201 09:00:07.120464 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:07.124430 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.123741 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:07.171345 17841 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:07.122720 17207 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:07.127758 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.124099 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.129751 17844 rpcz_store.cc:276] 0201 09:00:04.594593 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:04.594737 (+ 144us) service_pool.cc:225] Handling call
0201 09:00:04.595023 (+ 286us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:04.608709 (+ 13686us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:04.608739 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:04.641843 (+ 33104us) spinlock_profiling.cc:243] Waited 887 us on lock 0x7b2c00134c88. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74aeb389b1 00007f74aeb47fe2 00007f74b0275851 00007f74b023a0ba 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22
0201 09:00:04.642186 (+ 343us) log.cc:844] Serialized 26 byte log entry
0201 09:00:04.751646 (+109460us) raft_consensus.cc:1645] Marking committed up to 1
0201 09:00:04.751683 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:04.751752 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:06.810263 (+2058511us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 09:00:06.916782 (+106519us) raft_consensus.cc:1685] finished
0201 09:00:06.916824 (+ 42us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:06.916964 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13314,"raft.queue_time_us":14310,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"spinlock_wait_cycles":244945920,"thread_start_us":109133,"threads_started":1,"wal-append.queue_time_us":303716}
I20260201 09:00:07.132906 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.013892 18993 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.085628 18815 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:06.902994 19124 raft_consensus.cc:515] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.135736 19006 leader_election.cc:290] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.136211 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.143525 19138 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:07.137058 19137 log.cc:927] Time spent T ec25fe85ebfe48158cd273ded375fd96 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.118s user 0.001s sys 0.000s
I20260201 09:00:07.138159 18957 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.057088 18675 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:07.145824 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:07.206851 17793 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:07.207501 17283 raft_consensus.cc:2368] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:07.144479 18968 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:07.009727 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 149386us
I20260201 09:00:07.150940 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.054880 18946 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.160815 17284 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:07.212126 17284 raft_consensus.cc:606] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Received request to transfer leadership to TS 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:07.212476 17284 raft_consensus.cc:614] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 09:00:07.162361 17174 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:07.213635 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 51343us
I20260201 09:00:07.120232 18814 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:06.981053 18994 raft_consensus.cc:493] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:06.980670 18569 consensus_queue.cc:1059] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.138s
I20260201 09:00:07.173906 17103 leader_election.cc:400] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
W20260201 09:00:07.228991 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 62852.3us
I20260201 09:00:07.200170 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.062526 19139 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.116262 19129 raft_consensus.cc:493] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:07.142777 19101 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.183218 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.245563 17103 leader_election.cc:400] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:07.245999 17103 leader_election.cc:403] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260201 09:00:07.247191 17133 pending_rounds.cc:85] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting all ops after (but not including) 2
I20260201 09:00:07.247563 17133 pending_rounds.cc:107] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260201 09:00:07.247789 17133 raft_consensus.cc:2889] T 3d4bbc7074224d289f38153d63a1c181 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:07.133531 19093 raft_consensus.cc:697] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:07.189961 18815 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.190418 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.133077 19127 raft_consensus.cc:515] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.152426 19061 raft_consensus.cc:515] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.159955 18362 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.190450 19128 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.196134 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.277709 19128 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.278371 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.231340 18994 raft_consensus.cc:515] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.123786 19112 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.169399 18969 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:07.281236 18994 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.151345 18823 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.216799 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.282183 17848 raft_consensus.cc:2393] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:07.281917 18823 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.229115 18814 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.282954 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.218907 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.223778 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.284453 19130 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.058559 19099 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:07.211360 19145 log.cc:927] Time spent T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.078s user 0.001s sys 0.001s
I20260201 09:00:07.169999 19132 raft_consensus.cc:515] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.285305 17840 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:07.256203 18953 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7.
I20260201 09:00:07.255620 19129 raft_consensus.cc:515] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.286664 19132 leader_election.cc:290] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:07.287249 19132 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.287694 19132 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.287993 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.288360 19129 leader_election.cc:290] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.206494 18675 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.289062 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.289453 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c4343ae3470408987d247c06337e0a5" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.236308 17794 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.187069 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:07.290782 19141 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:07.222527 19036 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:07.261876 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 43875.6us
I20260201 09:00:07.205237 18811 raft_consensus.cc:493] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.291280 19141 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.291695 19036 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.291999 18811 raft_consensus.cc:515] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.293654 17129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46094 (request call id 582) took 1548 ms. Trace:
I20260201 09:00:07.294046 17129 rpcz_store.cc:276] 0201 09:00:05.745346 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:05.745494 (+ 148us) service_pool.cc:225] Handling call
0201 09:00:07.293481 (+1547987us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400588254. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:07.293575 (+ 94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2595337472}
I20260201 09:00:07.266182 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.119961 18909 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.269692 19075 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.272054 18946 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.272753 19138 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.273705 17203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 318) took 2430 ms. Trace:
I20260201 09:00:07.276760 19117 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.304420 18909 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.279349 18828 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.279466 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.236513 18980 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:07.293663 19036 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.283954 18823 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.284770 17131 raft_consensus.cc:2410] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 09:00:07.310019 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.310575 17131 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 09:00:07.310700 17839 raft_consensus.cc:1275] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:07.285430 18815 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:07.281594 18969 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:07.245824 19139 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.267208 19124 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.296219 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.283926 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.290419 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.290158 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6883c591b5547018eba339947c179ce" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.295270 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:07.277719 19053 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.290237 18362 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.272620 18931 leader_election.cc:290] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:07.247244 17846 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 09:00:07.307034 19130 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.349463 19093 consensus_queue.cc:237] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.350401 19130 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.283986 18814 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.350961 18967 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.351475 18967 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.303290 19075 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.353006 18993 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.353348 18967 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.354806 19127 leader_election.cc:290] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.357220 18967 raft_consensus.cc:2749] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:07.304358 17203 rpcz_store.cc:276] 0201 09:00:04.843331 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:04.846493 (+ 3162us) service_pool.cc:225] Handling call
0201 09:00:04.932367 (+ 85874us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:04.934371 (+ 2004us) raft_consensus.cc:1534] Early marking committed up to index 4
0201 09:00:06.556061 (+1621690us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b18001dad60. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad189335 00007f74b3c34317 00007f74b0244627 00007f74b0253d3f 00007f74b0253cb8
0201 09:00:06.905001 (+348940us) log.cc:844] Serialized 14 byte log entry
0201 09:00:07.245603 (+340602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:07.257286 (+ 11683us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:07.259906 (+ 2620us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:07.273502 (+ 13596us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:07.273642 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6669,"prepare.queue_time_us":23310,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":25647,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":4051200,"thread_start_us":647090,"threads_started":2,"wal-append.queue_time_us":430044}
I20260201 09:00:07.358942 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.359912 19075 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.360181 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.360697 19132 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:07.357390 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 121154us
I20260201 09:00:07.306656 18681 raft_consensus.cc:493] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.361718 19141 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.361629 18681 raft_consensus.cc:515] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.363782 17210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 563) took 2008 ms. Trace:
I20260201 09:00:07.305455 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.364192 17210 rpcz_store.cc:276] 0201 09:00:05.355318 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:05.355480 (+ 162us) service_pool.cc:225] Handling call
0201 09:00:05.355797 (+ 317us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:05.541313 (+185516us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:07.363527 (+1822214us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002ffdd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:07.363719 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":425202048}
I20260201 09:00:07.365134 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.366165 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.366698 17135 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 2.
I20260201 09:00:07.305796 17841 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:07.367650 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.278674 18968 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.304791 19117 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.285127 19099 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.312273 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.305096 17130 raft_consensus.cc:2393] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:07.368877 17131 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 09:00:07.369715 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.259994 19101 raft_consensus.cc:493] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.370296 19101 raft_consensus.cc:515] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.370654 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.371279 19117 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.371474 17131 raft_consensus.cc:2410] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260201 09:00:07.315126 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 100900us
I20260201 09:00:07.372133 19101 leader_election.cc:290] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.367479 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.373027 17135 raft_consensus.cc:2410] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260201 09:00:07.293982 18811 leader_election.cc:290] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:07.338564 17129 raft_consensus.cc:2393] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 3: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
W20260201 09:00:07.295634 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 51853.4us
I20260201 09:00:07.342159 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.343310 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.279767 19128 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.345129 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.346477 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.347384 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.361148 19119 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:07.368324 17128 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:07.446182 19119 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:07.446643 19119 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:07.446996 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.447217 17790 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:07.448086 18871 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:07.448433 18871 raft_consensus.cc:493] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:07.281190 19112 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.369968 19099 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.373927 17842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 683) took 1972 ms. Trace:
W20260201 09:00:07.373359 19104 log.cc:927] Time spent T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 1.751s user 0.019s sys 0.035s
I20260201 09:00:07.379570 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3d4bbc7074224d289f38153d63a1c181" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.381636 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.382855 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.384349 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.373245 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.385643 17794 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:07.453696 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 68149.9us
I20260201 09:00:07.455181 17134 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 09:00:07.386333 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.458352 17101 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.290216 18675 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.294857 19061 leader_election.cc:290] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.459587 17101 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.391803 17131 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.391175 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.461390 17131 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 5.
I20260201 09:00:07.395678 17248 leader_election.cc:304] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:07.396390 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.397028 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.463536 17276 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 2.
W20260201 09:00:07.386765 19150 log.cc:927] Time spent T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
I20260201 09:00:07.356784 19139 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.338896 18926 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:07.553339 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 157761us
I20260201 09:00:07.554034 17248 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:07.436514 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.392406 18968 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:07.448742 18871 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:07.449941 17842 rpcz_store.cc:276] 0201 09:00:05.401966 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:05.402116 (+ 150us) service_pool.cc:225] Handling call
0201 09:00:05.402411 (+ 295us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:05.456106 (+ 53695us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 09:00:06.024118 (+568012us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b180005ad00. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad189335 00007f74b3c34317 00007f74b0244627 00007f74b0253d3f 00007f74b0253cb8
0201 09:00:06.841392 (+817274us) log.cc:844] Serialized 14 byte log entry
0201 09:00:07.195178 (+353786us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:07.203586 (+ 8408us) log.cc:844] Serialized 26 byte log entry
0201 09:00:07.203734 (+ 148us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:07.203764 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:07.203839 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:07.373639 (+169800us) raft_consensus.cc:1685] finished
0201 09:00:07.373732 (+ 93us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:07.373856 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":94235,"prepare.queue_time_us":263347,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":86094,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":13108,"spinlock_wait_cycles":9822080,"thread_start_us":1132961,"threads_started":2,"wal-append.queue_time_us":432983}
I20260201 09:00:07.458743 17278 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 09:00:07.387264 17249 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:07.467258 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.467756 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6a0a5248f484893bbcb06eba6d364c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:07.558521 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 185332us
I20260201 09:00:07.468024 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.559279 17174 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.509322 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.452636 17280 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:07.463052 17279 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
W20260201 09:00:07.548213 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 84648.1us
I20260201 09:00:07.557581 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.561293 17101 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.560021 17135 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 09:00:07.549642 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.562213 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.550360 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.552196 17284 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.408010 18681 leader_election.cc:290] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.426383 18956 leader_election.cc:290] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.562850 17101 leader_election.cc:304] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:07.548147 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 94642.9us
I20260201 09:00:07.564997 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.594645 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.596364 17278 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.597477 17278 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:07.561729 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.602604 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe590c5ab6064559bcc7599baa5667c5" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.605602 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.443210 19101 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:07.606791 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 52836us
I20260201 09:00:07.607661 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.607724 17248 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:07.609107 17248 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:07.609263 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.546975 19099 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:07.610529 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.616423 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.552446 18362 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:07.611101 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.613642 17845 raft_consensus.cc:1240] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 5. Current term is 6. Ops: []
W20260201 09:00:07.614400 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 227205us
I20260201 09:00:07.558182 19068 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:07.563282 19075 raft_consensus.cc:2749] T 2c4343ae3470408987d247c06337e0a5 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:07.617745 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.611047 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.626641 17282 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:07.622581 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.627303 17209 raft_consensus.cc:2410] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260201 09:00:07.621399 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "927294866f7f46cb8fa5ddd1ad31b2a9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.557114 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b58ae14986de4b32bbd4ae3d2b530783" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.559307 18675 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.633819 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.626333 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.592670 19053 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:07.630388 17248 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
W20260201 09:00:07.631826 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 66075.9us
I20260201 09:00:07.634860 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.635419 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c35836a4583949f3b2ac7cbef2205db2" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.605757 18942 raft_consensus.cc:493] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260201 09:00:07.749629 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 119302us
I20260201 09:00:07.642087 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.750689 17248 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:07.622689 19085 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260201 09:00:07.748960 17848 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:07.633533 18980 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260201 09:00:07.704989 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 09:00:07.706280 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 81752us
I20260201 09:00:07.726457 17280 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 09:00:07.726620 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.795181 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:07.595404 18968 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.797853 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
W20260201 09:00:07.750396 17250 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.194.67:33911 timed out after 1.593s (SENT) [suppressed 3 similar messages]
I20260201 09:00:07.637017 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:07.622895 19061 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 09:00:07.737468 17136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 579) took 2464 ms. Trace:
I20260201 09:00:07.623595 18501 raft_consensus.cc:493] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.742779 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.622040 19165 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:07.708401 18675 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.626390 17794 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.621121 19101 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.606076 18823 raft_consensus.cc:2749] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:07.756521 18931 raft_consensus.cc:2804] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:07.744426 19100 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:07.768117 18926 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.827445 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.827710 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23892c545fda4a0ba2e3d29d32230ba3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.828377 17204 raft_consensus.cc:1240] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:07.770309 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aec9b4feb0a8410c98176562346a7ca9" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.729305 17846 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 09:00:07.774109 18994 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:07.755692 18942 raft_consensus.cc:515] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.777251 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.834365 17847 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 7.
W20260201 09:00:07.778841 19168 log.cc:927] Time spent T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.176s user 0.000s sys 0.001s
I20260201 09:00:07.838631 19163 raft_consensus.cc:493] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:07.839152 19163 raft_consensus.cc:515] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:07.779844 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.831862 19165 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:07.842166 19100 raft_consensus.cc:697] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:07.842619 19165 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:07.843379 17133 raft_consensus.cc:1240] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:07.780248 19162 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:07.843214 19100 consensus_queue.cc:237] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.843921 19162 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:07.781154 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.781834 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.780627 19114 raft_consensus.cc:493] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:07.783316 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.780601 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:07.785701 19158 log.cc:927] Time spent T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.180s user 0.000s sys 0.000s
I20260201 09:00:07.786077 19102 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:07.862326 19102 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.862761 19102 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:07.791612 17248 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:07.795126 17793 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 09:00:07.833060 19166 log.cc:927] Time spent T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.092s user 0.001s sys 0.000s
I20260201 09:00:07.799415 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.803718 17136 rpcz_store.cc:276] 0201 09:00:05.245363 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:05.245500 (+ 137us) service_pool.cc:225] Handling call
0201 09:00:05.245866 (+ 366us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:05.246253 (+ 387us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:05.246284 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:05.248267 (+ 1983us) log.cc:844] Serialized 26 byte log entry
0201 09:00:05.510264 (+261997us) raft_consensus.cc:1645] Marking committed up to 2
0201 09:00:05.510312 (+ 48us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:05.510378 (+ 66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:07.362079 (+1851701us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b24004a42d8. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74acfe0ad4 00007f74acfdebdb 00007f74ad06dad9 00007f74ad06d765 00007f74ad06cdad 00007f74afdbd4ae 00007f74afdd4c2c 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1
0201 09:00:07.629479 (+267400us) raft_consensus.cc:1685] finished
0201 09:00:07.629500 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:07.709402 (+ 79902us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3365,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14241,"spinlock_wait_cycles":10097536,"thread_start_us":221933,"threads_started":1,"wal-append.queue_time_us":266043}
I20260201 09:00:07.813541 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:07.765784 19161 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260201 09:00:07.818962 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 192638us
W20260201 09:00:07.869469 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 74400.8us
I20260201 09:00:07.869942 17794 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.821216 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3d3eb882b354a0089a1a129ce4be4c1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.821112 17134 raft_consensus.cc:1275] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Refusing update from remote peer f5398ba4a58b40ca9b78a210cdb7ae4d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260201 09:00:07.831182 19167 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260201 09:00:07.898629 17136 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.831827 17283 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:07.899360 17278 raft_consensus.cc:606] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Received request to transfer leadership to TS 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:07.899878 17278 raft_consensus.cc:614] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 09:00:07.824010 18931 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:07.899605 17175 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.837908 18942 leader_election.cc:290] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.845402 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.905372 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.844329 19162 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:07.855072 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:07.847065 18994 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.857474 19114 raft_consensus.cc:515] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:07.859978 18969 consensus_meta.cc:287] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.516s user 0.006s sys 0.002s
I20260201 09:00:07.861757 19165 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:07.799405 17249 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:07.826804 19064 raft_consensus.cc:2749] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:07.909111 17175 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.815783 18501 raft_consensus.cc:515] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:07.925704 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.930377 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:07.931074 17129 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 5.
I20260201 09:00:07.931854 19161 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:07.931823 18958 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260201 09:00:07.932368 19161 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.898420 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.938401 17102 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:07.898443 19167 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
W20260201 09:00:07.921023 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 121691us
I20260201 09:00:07.944389 17249 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:07.945793 17249 leader_election.cc:304] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:07.932758 19161 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:07.906848 19163 leader_election.cc:290] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:07.946698 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.911178 19067 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260201 09:00:07.921645 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 156022us
I20260201 09:00:07.914664 18968 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:07.907786 18931 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:07.902094 19068 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:07.939754 17102 leader_election.cc:304] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.912037 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:07.941802 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.924805 17101 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:07.953490 17248 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 09:00:07.955749 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 205364us
I20260201 09:00:07.911442 19115 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:07.965855 17249 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:07.960529 17102 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:07.927460 19075 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:07.969942 17102 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:07.935249 19165 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:07.975531 17845 raft_consensus.cc:2393] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 5: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:07.966580 17177 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.978675 17177 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.979861 17177 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.941718 18823 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:07.981323 17177 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:07.951535 18675 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:07.977115 17102 leader_election.cc:304] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:07.952277 19167 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:07.920276 18969 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:07.954339 18811 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:07.963554 19115 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:07.972790 19152 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:07.997391 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:07.977815 18968 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:07.984262 19006 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.010279 18501 leader_election.cc:290] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:08.010664 19177 log.cc:927] Time spent T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.161s user 0.000s sys 0.001s
I20260201 09:00:08.001631 19152 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:07.991550 19163 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:08.007543 17841 raft_consensus.cc:1240] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260201 09:00:07.999540 18811 raft_consensus.cc:493] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:07.989905 19075 raft_consensus.cc:2749] T 3d4bbc7074224d289f38153d63a1c181 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:08.002110 19117 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:07.991711 18681 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:08.017469 17211 raft_consensus.cc:2393] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:07.998049 18675 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:08.001008 19115 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:08.029392 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.001223 19127 raft_consensus.cc:2749] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:07.994587 19124 consensus_queue.cc:1059] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260201 09:00:08.026296 18675 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:08.017879 19152 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.028784 18811 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.026964 19101 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.042630 18675 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:08.026763 19114 leader_election.cc:290] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:08.025725 18501 consensus_queue.cc:1059] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260201 09:00:08.014472 19100 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.041985 17210 raft_consensus.cc:2468] T 457eeb0a14cc4d28823521cfef13996e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
W20260201 09:00:08.071547 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 118119us
I20260201 09:00:08.033288 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.075320 17248 leader_election.cc:304] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:08.079074 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 113289us
I20260201 09:00:08.082563 17103 leader_election.cc:304] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.085116 17103 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.087450 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.110646 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.114125 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.114828 17202 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:08.114954 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:08.115808 17103 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:08.077925 19112 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.116211 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.117594 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.043470 19182 consensus_queue.cc:1059] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260201 09:00:08.085294 18501 consensus_queue.cc:1243] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer 35484ac93d564e958f85965bd740a18f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260201 09:00:08.123373 17174 leader_election.cc:304] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:08.123634 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 148599us
I20260201 09:00:08.085546 19100 raft_consensus.cc:2749] T b58ae14986de4b32bbd4ae3d2b530783 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:08.125147 17103 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:08.125418 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.086665 18953 raft_consensus.cc:2749] T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260201 09:00:08.127476 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 146230us
I20260201 09:00:08.130165 18501 raft_consensus.cc:2749] T 23892c545fda4a0ba2e3d29d32230ba3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:08.130460 19099 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:08.122128 19053 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:08.090507 18994 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:08.124722 19165 raft_consensus.cc:493] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:08.135051 19165 raft_consensus.cc:515] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:08.136986 19165 leader_election.cc:290] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
W20260201 09:00:08.137408 19181 log.cc:927] Time spent T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20260201 09:00:08.129722 17249 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:08.129096 17202 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:08.089378 18823 raft_consensus.cc:2749] T e6a0a5248f484893bbcb06eba6d364c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.138088 19125 raft_consensus.cc:3055] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:08.138489 19125 raft_consensus.cc:740] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:08.139031 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.139284 19125 consensus_queue.cc:260] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:08.140093 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.140398 19125 raft_consensus.cc:3060] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:08.141100 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.141357 19099 raft_consensus.cc:493] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:08.142710 19099 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:08.142129 17793 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.084599 17203 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 8.
W20260201 09:00:08.124449 18871 consensus_meta.cc:287] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.518s user 0.009s sys 0.001s
I20260201 09:00:08.145692 17793 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:08.143656 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9dd88f5c612b4e5985855eee079c4716" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:08.148721 17103 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 09:00:08.149983 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 172924us
I20260201 09:00:08.151872 17102 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:08.148043 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:08.155807 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:08.149003 18847 raft_consensus.cc:2749] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:08.156975 19073 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P 35484ac93d564e958f85965bd740a18f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:08.158152 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.159291 19127 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:08.159734 19127 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:08.158712 17103 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:08.161078 17103 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.163218 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:08.263347 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b8fb1d921544e74ad028b4471690420" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:08.264945 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
W20260201 09:00:08.307017 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 159043us
I20260201 09:00:08.307826 17174 leader_election.cc:304] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:08.305130 19006 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:08.153034 18942 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260201 09:00:08.322885 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 173398us
I20260201 09:00:08.151954 19130 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260201 09:00:08.314265 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 153240us
I20260201 09:00:08.160125 19127 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.423840 17103 leader_election.cc:304] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.425112 17103 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.426235 17103 leader_election.cc:304] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.427270 17103 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:08.323915 17174 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.327795 18942 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:08.428737 18942 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:08.152969 18871 raft_consensus.cc:515] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:08.429741 19163 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:08.430454 18823 raft_consensus.cc:2749] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.431082 18823 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:08.431667 18823 raft_consensus.cc:2749] T fe590c5ab6064559bcc7599baa5667c5 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:08.432276 18823 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:08.142831 18811 raft_consensus.cc:515] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.432626 18823 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:08.433802 18823 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.323716 19139 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 09:00:08.151222 19136 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.263s
I20260201 09:00:08.436118 19152 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:08.436650 19119 consensus_meta.cc:287] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.990s user 0.009s sys 0.001s
I20260201 09:00:08.437067 19119 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:08.437799 18942 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.438934 19119 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:08.440249 18942 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.443128 19130 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:08.443653 19130 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.444682 17840 raft_consensus.cc:1240] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260201 09:00:08.416391 19101 raft_consensus.cc:493] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:08.316135 19124 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:08.449088 19124 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:08.449894 17842 raft_consensus.cc:1240] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:08.159976 19102 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:08.420138 19184 log.cc:927] Time spent T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.277s user 0.000s sys 0.000s
I20260201 09:00:08.420581 19118 raft_consensus.cc:2749] T c3d3eb882b354a0089a1a129ce4be4c1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:08.162140 18969 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:08.422021 19192 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:08.429037 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 105218us
I20260201 09:00:08.434487 18811 leader_election.cc:290] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.419905 17130 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 594) took 1117 ms. Trace:
W20260201 09:00:08.416108 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:08.323905 19114 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:08.449045 19101 raft_consensus.cc:515] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.502840 17174 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:08.531224 17279 raft_consensus.cc:1240] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:08.524926 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.430687 18871 leader_election.cc:290] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:08.505124 17130 rpcz_store.cc:276] 0201 09:00:07.302346 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.450744 (+148398us) service_pool.cc:225] Handling call
0201 09:00:07.451031 (+ 287us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:07.451372 (+ 341us) raft_consensus.cc:1534] Early marking committed up to index 3
0201 09:00:07.745805 (+294433us) log.cc:844] Serialized 14 byte log entry
0201 09:00:07.999436 (+253631us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:08.006878 (+ 7442us) log.cc:844] Serialized 26 byte log entry
0201 09:00:08.007006 (+ 128us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:08.010078 (+ 3072us) log.cc:844] Serialized 14 byte log entry
0201 09:00:08.010880 (+ 802us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.010949 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:08.134732 (+123783us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b180012f700. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad18c2d3 00007f74ad18e6a1 00007f74ad18e659 00007f74ad18e5e9 00007f74ad18e5b1 00007f74ad18d8ad 0000000000379254 0000000000379099 00007f74ad16f69a
0201 09:00:08.419637 (+284905us) raft_consensus.cc:1685] finished
0201 09:00:08.419671 (+ 34us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:08.419848 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21482,"prepare.queue_time_us":388018,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":5266,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":4426,"spinlock_wait_cycles":37490304,"thread_start_us":480282,"threads_started":2,"wal-append.queue_time_us":313201}
I20260201 09:00:08.532199 17210 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
W20260201 09:00:08.501857 18931 consensus_meta.cc:287] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.525s user 0.003s sys 0.005s
W20260201 09:00:08.525070 19162 consensus_meta.cc:287] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.605s user 0.008s sys 0.000s
W20260201 09:00:08.530658 19161 consensus_meta.cc:287] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.583s user 0.004s sys 0.004s
I20260201 09:00:08.481376 19124 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:08.491029 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "68c080f2c06d4219bdb2e4a546153bc4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.524852 19118 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
W20260201 09:00:08.531065 19167 consensus_meta.cc:287] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.530s user 0.000s sys 0.007s
I20260201 09:00:08.542788 17174 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:08.557343 18695 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.533123 18811 raft_consensus.cc:493] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:08.571041 17177 leader_election.cc:304] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:08.563192 19161 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:08.565135 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 09:00:08.570742 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 142560us
I20260201 09:00:08.565220 19152 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:08.540889 18969 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:08.527623 18823 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.592943 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:08.587414 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:08.593672 17135 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.593906 17130 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:08.598618 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.599285 17210 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:08.563266 19102 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:08.525792 19192 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.566632 19130 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.566689 19163 raft_consensus.cc:493] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:08.570320 19194 raft_consensus.cc:493] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:08.546708 18931 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.609622 19186 raft_consensus.cc:493] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:08.610374 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:08.557713 19162 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.620133 17207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 767) took 1025 ms. Trace:
I20260201 09:00:08.625047 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:08.625674 17210 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.625406 17132 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:08.623708 17207 rpcz_store.cc:276] 0201 09:00:07.594338 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.595821 (+ 1483us) service_pool.cc:225] Handling call
0201 09:00:07.614490 (+ 18669us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:07.627701 (+ 13211us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:07.627733 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:07.634640 (+ 6907us) log.cc:844] Serialized 26 byte log entry
0201 09:00:07.953926 (+319286us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18003db8e0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad16ec67 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74afdd35ab 00007f74afdd90c3 00007f74afdd9471 00007f74b01f573f
0201 09:00:08.152907 (+198981us) raft_consensus.cc:1645] Marking committed up to 2
0201 09:00:08.153156 (+ 249us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.153224 (+ 68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:08.610519 (+457295us) raft_consensus.cc:1685] finished
0201 09:00:08.610541 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:08.620057 (+ 9516us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3874,"raft.queue_time_us":8947,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11803,"spinlock_wait_cycles":4627328,"thread_start_us":198787,"threads_started":1,"wal-append.queue_time_us":787891}
I20260201 09:00:08.598235 19165 raft_consensus.cc:2749] T 9dd88f5c612b4e5985855eee079c4716 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.606431 19114 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:08.575810 19118 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.587100 19167 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.585824 18811 raft_consensus.cc:515] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.666857 17277 raft_consensus.cc:1240] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:08.595227 18969 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.671296 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:08.674388 17248 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
W20260201 09:00:08.668982 19187 log.cc:927] Time spent T c35836a4583949f3b2ac7cbef2205db2 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.057s user 0.000s sys 0.001s
I20260201 09:00:08.616001 19163 raft_consensus.cc:515] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:08.656813 19114 raft_consensus.cc:493] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:08.661779 17210 raft_consensus.cc:2468] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:08.631477 19186 raft_consensus.cc:515] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.701059 19101 leader_election.cc:290] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.702494 19186 leader_election.cc:290] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.620496 19194 raft_consensus.cc:515] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.705459 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:08.707902 19162 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:08.710158 18969 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.712314 19118 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.713997 19167 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:08.716373 18931 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:08.717684 19127 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:08.719954 18968 raft_consensus.cc:3055] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:08.720441 18968 raft_consensus.cc:740] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:08.671552 19029 consensus_queue.cc:1059] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260201 09:00:08.721232 18968 consensus_queue.cc:260] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:08.722189 18968 raft_consensus.cc:3060] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
W20260201 09:00:08.722652 19115 consensus_meta.cc:287] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.683s user 0.006s sys 0.001s
I20260201 09:00:08.723035 19115 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:08.727895 19163 leader_election.cc:290] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:08.728842 19114 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:08.666428 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.753683 18823 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.754968 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:08.755824 17280 raft_consensus.cc:2393] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 6: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:08.757143 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:08.757902 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f36c29f280a42faa270584136681eda" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.759115 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.760150 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dc19ac6347fa40b7b6d2c6912c975575" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.760442 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:08.761549 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.762176 17210 raft_consensus.cc:2468] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:08.763188 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:08.764370 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73e3e5cdfd85463abd7eeb4fe5b87c77" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.698544 19199 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:08.720057 19127 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:08.769471 19161 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:08.780295 19199 raft_consensus.cc:493] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:08.790325 19199 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
W20260201 09:00:08.781358 18675 consensus_meta.cc:287] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.703s user 0.005s sys 0.005s
I20260201 09:00:08.794886 18675 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:08.781715 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:08.783414 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:08.780265 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:08.805680 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
W20260201 09:00:08.831056 19099 consensus_meta.cc:287] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.679s user 0.008s sys 0.000s
I20260201 09:00:08.897121 19099 raft_consensus.cc:515] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.837682 18675 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:08.898787 17132 raft_consensus.cc:2368] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:08.838157 17210 raft_consensus.cc:2410] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260201 09:00:08.900074 17210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 786) took 1082 ms. Trace:
I20260201 09:00:08.866824 19199 raft_consensus.cc:515] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:08.901221 17210 rpcz_store.cc:276] 0201 09:00:07.817930 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:08.763993 (+946063us) service_pool.cc:225] Handling call
0201 09:00:08.900008 (+136015us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:08.868268 19114 raft_consensus.cc:515] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:08.903115 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "646f532b2c434b56b4efba4e815711a7" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:08.904095 19114 leader_election.cc:290] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:08.895352 19125 consensus_meta.cc:287] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Time spent flushing consensus metadata: real 0.755s user 0.010s sys 0.000s
I20260201 09:00:08.837355 19115 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.832342 17135 raft_consensus.cc:2468] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:08.904804 17210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 349) took 1279 ms. Trace:
I20260201 09:00:08.905495 17203 raft_consensus.cc:2410] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260201 09:00:08.935127 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:08.935298 17131 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54340 (request call id 360) took 1148 ms. Trace:
I20260201 09:00:08.906780 19199 leader_election.cc:290] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:08.921046 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 378313us
I20260201 09:00:08.937371 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.913430 17839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 696) took 1670 ms. Trace:
I20260201 09:00:08.938010 17843 raft_consensus.cc:1275] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:08.939083 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:08.940140 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.940447 17174 leader_election.cc:304] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:08.911631 19127 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:08.910938 19124 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:08.941830 19127 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:08.942309 17129 raft_consensus.cc:1275] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260201 09:00:08.943529 19124 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:08.943871 19127 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.942051 17844 raft_consensus.cc:1240] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 5. Current term is 6. Ops: []
W20260201 09:00:08.944933 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 362950us
I20260201 09:00:08.945787 19112 raft_consensus.cc:2749] T 2b8fb1d921544e74ad028b4471690420 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.943615 17129 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54340 (request call id 368) took 1021 ms. Trace:
I20260201 09:00:08.934144 19099 leader_election.cc:290] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:08.946715 17133 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 744) took 1127 ms. Trace:
I20260201 09:00:08.929816 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.947993 17841 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:08.951462 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:08.951658 17848 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:08.952260 17848 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.938019 17839 rpcz_store.cc:276] 0201 09:00:07.243512 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.332120 (+ 88608us) service_pool.cc:225] Handling call
0201 09:00:07.365522 (+ 33402us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:07.365870 (+ 348us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:07.365897 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:07.366360 (+ 463us) log.cc:844] Serialized 26 byte log entry
0201 09:00:07.622390 (+256030us) raft_consensus.cc:1645] Marking committed up to 2
0201 09:00:07.622431 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:07.622490 (+ 59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:08.017137 (+394647us) raft_consensus.cc:1685] finished
0201 09:00:08.017158 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:08.913153 (+895995us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54000050d0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:08.913374 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1032,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"spinlock_wait_cycles":75911936,"thread_start_us":255547,"threads_started":1,"wal-append.queue_time_us":497176}
I20260201 09:00:08.955719 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.955811 17846 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39018 (request call id 693) took 1488 ms. Trace:
I20260201 09:00:08.956228 17846 rpcz_store.cc:276] 0201 09:00:07.467701 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.549046 (+ 81345us) service_pool.cc:225] Handling call
0201 09:00:08.955626 (+1406580us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54000069d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:08.955723 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":72967936}
I20260201 09:00:08.956797 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:08.957504 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:08.959621 19203 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:08.961585 17841 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:08.963599 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.964768 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.946380 17129 rpcz_store.cc:276] 0201 09:00:07.922162 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.937571 (+ 15409us) service_pool.cc:225] Handling call
0201 09:00:08.942021 (+1004450us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:08.942660 (+ 639us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.943456 (+ 796us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b5400272c50. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:08.943564 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2298604928}
W20260201 09:00:08.956571 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 273298us
I20260201 09:00:08.945719 17205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 345) took 1335 ms. Trace:
W20260201 09:00:08.966292 17102 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:08.966611 17278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55128 (request call id 6) took 1373 ms. Trace:
I20260201 09:00:08.967790 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:08.956285 19073 raft_consensus.cc:3055] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:08.959777 17249 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:08.975019 17790 leader_election.cc:304] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 09:00:09.036295 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 61362.2us
I20260201 09:00:08.968828 17841 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:09.037438 17841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:09.038005 19085 raft_consensus.cc:2804] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:09.038530 19085 raft_consensus.cc:697] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:09.038661 18799 consensus_queue.cc:1048] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:08.977087 18569 raft_consensus.cc:493] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.039958 18569 raft_consensus.cc:515] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.041363 19085 consensus_queue.cc:237] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.041988 18569 leader_election.cc:290] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:09.044580 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.045647 17128 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46094 (request call id 588) took 1781 ms. Trace:
I20260201 09:00:09.045940 17137 raft_consensus.cc:1240] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:09.061198 18871 consensus_queue.cc:1059] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:09.063315 17128 rpcz_store.cc:276] 0201 09:00:07.264463 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.449178 (+184715us) service_pool.cc:225] Handling call
0201 09:00:07.449465 (+ 287us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:07.824076 (+374611us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:07.824106 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:07.824147 (+ 41us) raft_consensus.cc:1645] Marking committed up to 1
0201 09:00:07.824175 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.045453 (+1221278us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54001dc9d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:09.045496 (+ 43us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.045600 (+ 104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":861095168}
I20260201 09:00:08.907238 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:09.066243 17135 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
W20260201 09:00:09.068290 17250 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s user 0.004s sys 0.013s
W20260201 09:00:09.068651 17250 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s user 0.004s sys 0.013s
I20260201 09:00:08.975715 17839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:09.069126 17839 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:09.069370 17848 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
W20260201 09:00:09.002421 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:08.984637 17281 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:09.073655 17281 raft_consensus.cc:2393] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:09.021657 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 781) took 1267 ms. Trace:
I20260201 09:00:08.986091 18956 consensus_queue.cc:1059] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260201 09:00:09.079296 18956 raft_consensus.cc:3055] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:09.079661 18956 raft_consensus.cc:740] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:09.027878 17136 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46082 (request call id 753) took 1181 ms. Trace:
I20260201 09:00:08.988344 17129 raft_consensus.cc:1275] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:09.080411 18956 consensus_queue.cc:260] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:09.081732 18956 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:08.935715 17131 rpcz_store.cc:276] 0201 09:00:07.786938 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.790962 (+ 4024us) service_pool.cc:225] Handling call
0201 09:00:08.934607 (+1143645us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5800002198. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 09:00:08.934818 (+ 211us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:08.935006 (+ 188us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:08.935031 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:08.935072 (+ 41us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:08.935100 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.935150 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:08.935246 (+ 96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3555584}
I20260201 09:00:09.028048 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 768) took 1425 ms. Trace:
I20260201 09:00:09.082754 17204 rpcz_store.cc:276] 0201 09:00:07.603047 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.603290 (+ 243us) service_pool.cc:225] Handling call
0201 09:00:07.603570 (+ 280us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:07.828819 (+225249us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.027851 (+1199032us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400570154. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:09.027991 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":465730432}
I20260201 09:00:09.083894 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.080392 17839 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:09.085000 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "457eeb0a14cc4d28823521cfef13996e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.085974 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.086476 17204 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:09.087241 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.024508 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.033730 17844 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:09.029356 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:09.033927 17278 rpcz_store.cc:276] 0201 09:00:07.593605 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.597368 (+ 3763us) service_pool.cc:225] Handling call
0201 09:00:08.966434 (+1369066us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54000a05d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b02344d3 00007f74b51f213a 00007f74ae78d934 00007f74ae78d8c2 00007f74ae78d7f1 00007f74ae78d76c 00007f74ae78ca22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:08.966532 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":692923136}
I20260201 09:00:09.088953 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 777) took 1350 ms. Trace:
I20260201 09:00:09.034066 19073 raft_consensus.cc:740] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:09.034526 19100 raft_consensus.cc:3055] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Stepping down as leader of term 4
W20260201 09:00:09.034657 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 74977.1us
I20260201 09:00:09.090677 17135 raft_consensus.cc:2468] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:09.090999 17249 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:09.091951 17249 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:08.969393 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:09.092173 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.034891 19087 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:08.947114 17133 rpcz_store.cc:276] 0201 09:00:07.819820 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.822685 (+ 2865us) service_pool.cc:225] Handling call
0201 09:00:07.822949 (+ 264us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:07.843769 (+ 20820us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.941880 (+1098111us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400272c54. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:08.946658 (+ 4778us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46559488}
I20260201 09:00:08.980331 17285 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 6. Current term is 7. Ops: []
W20260201 09:00:08.980441 17283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54632 (request call id 749) took 1586 ms (client timeout 1627 ms). Trace:
I20260201 09:00:08.979862 17840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39002 (request call id 708) took 1037 ms. Trace:
I20260201 09:00:09.038070 17841 raft_consensus.cc:2368] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6.
I20260201 09:00:09.095748 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:08.983402 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:08.984028 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:08.941097 17845 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39002 (request call id 706) took 1068 ms. Trace:
I20260201 09:00:09.096531 17204 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:09.019518 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:08.984359 19165 raft_consensus.cc:493] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:08.935158 17210 rpcz_store.cc:276] 0201 09:00:07.624958 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:08.904045 (+1279087us) service_pool.cc:225] Handling call
0201 09:00:08.904325 (+ 280us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:08.904483 (+ 158us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:08.904519 (+ 36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:08.904561 (+ 42us) raft_consensus.cc:1645] Marking committed up to 5
0201 09:00:08.904592 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.904646 (+ 54us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:08.904752 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.058470 17248 leader_election.cc:400] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:09.045832 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.089290 17202 rpcz_store.cc:276] 0201 09:00:07.738878 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:08.322590 (+583712us) service_pool.cc:225] Handling call
0201 09:00:09.024331 (+701741us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 09:00:09.088882 (+ 64551us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":70778240}
I20260201 09:00:09.080541 17136 rpcz_store.cc:276] 0201 09:00:07.846086 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.899505 (+ 53419us) service_pool.cc:225] Handling call
0201 09:00:07.899822 (+ 317us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:07.900024 (+ 202us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:07.900046 (+ 22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0201 09:00:07.917180 (+ 17134us) log.cc:844] Serialized 26 byte log entry
0201 09:00:08.071271 (+154091us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:08.088292 (+ 17021us) log.cc:844] Serialized 14 byte log entry
0201 09:00:08.116581 (+ 28289us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.116650 (+ 69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0201 09:00:08.976355 (+859705us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b180012e860. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad15a2d6 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad18c2d3 00007f74ad18e6a1
0201 09:00:08.976908 (+ 553us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b180012e860. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b5fe0c91 00007f74b5fed671 00007f74ad18c2d3 00007f74ad18e6a1 00007f74ad18e659 00007f74ad18e5e9 00007f74ad18e5b1 00007f74ad18d8ad 0000000000379254 0000000000379099 00007f74ad16f69a
0201 09:00:09.027672 (+ 50764us) raft_consensus.cc:1685] finished
0201 09:00:09.027693 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.027818 (+ 125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30851,"prepare.queue_time_us":17933,"prepare.run_wall_time_us":5371,"raft.queue_time_us":28331,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5797,"spinlock_wait_cycles":60982912,"thread_start_us":108531,"threads_started":1,"wal-append.queue_time_us":191433}
I20260201 09:00:09.092799 17843 raft_consensus.cc:2368] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:09.093677 17249 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:09.016098 17206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 769) took 1410 ms. Trace:
I20260201 09:00:09.091161 17208 rpcz_store.cc:276] 0201 09:00:07.754348 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:08.937132 (+1182784us) service_pool.cc:225] Handling call
0201 09:00:09.021597 (+ 84465us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:08.981539 17205 rpcz_store.cc:276] 0201 09:00:07.609854 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.614299 (+ 4445us) service_pool.cc:225] Handling call
0201 09:00:07.736906 (+122607us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:07.974878 (+237972us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:07.979761 (+ 4883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:07.989074 (+ 9313us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:07.992929 (+ 3855us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.945502 (+952573us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400499dd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:08.945550 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:08.945666 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":501785216}
W20260201 09:00:09.095424 17283 rpcz_store.cc:269] 0201 09:00:07.393742 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.436253 (+ 42511us) service_pool.cc:225] Handling call
0201 09:00:08.980058 (+1543805us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54000a05d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:08.980394 (+ 336us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":633607040}
I20260201 09:00:09.175341 17132 raft_consensus.cc:1240] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260201 09:00:09.245906 17248 leader_election.cc:403] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260201 09:00:09.249506 17846 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:09.104804 17793 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:09.253413 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 148722us
I20260201 09:00:09.108462 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:09.246850 19087 raft_consensus.cc:2749] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:09.258970 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.259728 17202 raft_consensus.cc:3060] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:09.140128 17133 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:09.262712 17129 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:09.258571 17136 raft_consensus.cc:1240] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:09.248054 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce4e1322b3134c60b0641a8941a7f76e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.094908 19075 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260201 09:00:09.249046 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 137522us
I20260201 09:00:09.147746 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 770) took 1534 ms. Trace:
I20260201 09:00:09.090368 19100 raft_consensus.cc:740] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
W20260201 09:00:09.174389 17101 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:09.245774 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.277786 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.278429 17101 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:09.247429 17249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 153795us
I20260201 09:00:09.282195 17203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 787) took 1163 ms. Trace:
I20260201 09:00:09.282627 17203 rpcz_store.cc:276] 0201 09:00:08.118790 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:08.759907 (+641117us) service_pool.cc:225] Handling call
0201 09:00:09.282003 (+522096us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54004e7854. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:09.282139 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":332308736}
I20260201 09:00:09.283267 17136 raft_consensus.cc:1240] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:09.258522 19165 raft_consensus.cc:515] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.283653 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.247504 17845 rpcz_store.cc:276] 0201 09:00:07.903391 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.911763 (+ 8372us) service_pool.cc:225] Handling call
0201 09:00:08.940930 (+1029167us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b540000b4d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:08.941045 (+ 115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":32604416}
I20260201 09:00:09.251694 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.292049 17204 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:09.292737 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.254267 17135 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3beb95bbbb64b4485bc29a00f4c7854" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:09.254173 17130 raft_consensus.cc:2393] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 3: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:09.295684 17202 raft_consensus.cc:2468] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:09.285444 17249 leader_election.cc:304] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:09.297432 17204 raft_consensus.cc:2393] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:09.297950 17249 leader_election.cc:400] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:09.298008 17280 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d"
dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
mode: GRACEFUL
new_leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
from {username='slave'} at 127.0.0.1:55128
I20260201 09:00:09.298720 17280 raft_consensus.cc:606] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Received request to transfer leadership to TS 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:09.298952 17280 raft_consensus.cc:614] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260201 09:00:09.245751 17206 rpcz_store.cc:276] 0201 09:00:07.606110 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.606313 (+ 203us) service_pool.cc:225] Handling call
0201 09:00:09.015120 (+1408807us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b5203af0 00007f74b51ee459 00007f74b51edf02 00007f74ae77ad34
0201 09:00:09.015371 (+ 251us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.015713 (+ 342us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.015742 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.015788 (+ 46us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:09.015818 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.015907 (+ 89us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.016030 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":582,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":86,"spinlock_wait_cycles":2385792}
I20260201 09:00:09.247268 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.095681 17840 rpcz_store.cc:276] 0201 09:00:07.942169 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.942329 (+ 160us) service_pool.cc:225] Handling call
0201 09:00:07.942595 (+ 266us) raft_consensus.cc:1471] Updating replica for 1 ops
0201 09:00:08.445137 (+502542us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:08.979627 (+534490us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54000082d4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:08.979800 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1154090752}
I20260201 09:00:09.256773 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5373f77eaf6a488faf35417ffdaa32b3" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:09.301074 17132 raft_consensus.cc:2368] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6.
I20260201 09:00:09.257555 17793 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35484ac93d564e958f85965bd740a18f; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.264915 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:09.096647 17282 raft_consensus.cc:3060] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:09.266320 17276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 380) took 1340 ms. Trace:
I20260201 09:00:09.267529 19192 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:09.302841 17276 rpcz_store.cc:276] 0201 09:00:07.925508 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.925655 (+ 147us) service_pool.cc:225] Handling call
0201 09:00:07.947025 (+ 21370us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:07.980408 (+ 33383us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:07.980440 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:07.980484 (+ 44us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:07.980515 (+ 31us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.266092 (+1285577us) spinlock_profiling.cc:243] Waited 33.2 ms on lock 0x7b540052cbd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:09.266144 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.266265 (+ 121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":76312320}
I20260201 09:00:09.305236 17102 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:09.148175 17128 raft_consensus.cc:1240] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:09.269990 17842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39018 (request call id 704) took 1324 ms. Trace:
I20260201 09:00:09.247681 19186 raft_consensus.cc:493] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:09.163947 18569 raft_consensus.cc:493] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:09.148422 19121 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:09.274571 17211 rpcz_store.cc:276] 0201 09:00:07.613180 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.616841 (+ 3661us) service_pool.cc:225] Handling call
0201 09:00:09.147509 (+1530668us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54002afdd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023df7a 00007f74b51ef647 00007f74ae77f834 00007f74ae77f7c2 00007f74ae77f6f1 00007f74ae77f66c 00007f74ae77e922 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:09.147682 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":500176128}
I20260201 09:00:09.262722 18989 raft_consensus.cc:2804] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:09.278786 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6af74496ca1949d78f5a2a08f5cb9635" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.180027 19073 consensus_queue.cc:260] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:09.316211 14089 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260201 09:00:09.319027 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 61574.8us
W20260201 09:00:09.252947 17248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 194637us
I20260201 09:00:09.262811 18743 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:09.307482 17842 rpcz_store.cc:276] 0201 09:00:07.945935 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.946062 (+ 127us) service_pool.cc:225] Handling call
0201 09:00:07.965890 (+ 19828us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:08.450286 (+484396us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.269786 (+819500us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540000afd4. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:09.269946 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1112641920}
I20260201 09:00:09.309311 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 355) took 1494 ms. Trace:
I20260201 09:00:09.327137 17204 rpcz_store.cc:276] 0201 09:00:07.814621 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.308509 (+1493888us) service_pool.cc:225] Handling call
0201 09:00:09.308812 (+ 303us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.309017 (+ 205us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.309042 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.309083 (+ 41us) raft_consensus.cc:1645] Marking committed up to 5
0201 09:00:09.309112 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.309165 (+ 53us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.309262 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.329031 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 569) took 1494 ms. Trace:
I20260201 09:00:09.330222 18743 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.329398 17204 rpcz_store.cc:276] 0201 09:00:07.834837 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.328124 (+1493287us) service_pool.cc:225] Handling call
0201 09:00:09.328496 (+ 372us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.328679 (+ 183us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.328707 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.328752 (+ 45us) raft_consensus.cc:1645] Marking committed up to 1
0201 09:00:09.328781 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.328843 (+ 62us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.328979 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.332738 17206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 352) took 1548 ms. Trace:
I20260201 09:00:09.333200 17206 rpcz_store.cc:276] 0201 09:00:07.784192 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.308753 (+1524561us) service_pool.cc:225] Handling call
0201 09:00:09.332213 (+ 23460us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.332395 (+ 182us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.332420 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.332461 (+ 41us) raft_consensus.cc:1645] Marking committed up to 2
0201 09:00:09.332491 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.332570 (+ 79us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.332682 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.331710 17248 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:09.335337 17204 raft_consensus.cc:1240] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 7. Current term is 8. Ops: []
I20260201 09:00:09.309514 17202 raft_consensus.cc:1240] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:09.310667 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 354) took 1499 ms. Trace:
I20260201 09:00:09.309106 17102 leader_election.cc:304] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:09.289976 18968 raft_consensus.cc:2749] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:09.323398 17282 raft_consensus.cc:2468] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:09.338750 17279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36914 (request call id 383) took 1412 ms. Trace:
I20260201 09:00:09.311203 19127 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260201 09:00:09.311390 18956 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.312614 19121 raft_consensus.cc:493] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:09.339905 19036 raft_consensus.cc:2749] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 3. Current term is 4.
I20260201 09:00:09.350757 19090 raft_consensus.cc:2804] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:09.352289 17205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 357) took 1527 ms. Trace:
I20260201 09:00:09.334893 19132 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:09.342248 18968 raft_consensus.cc:2749] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:09.339131 17279 rpcz_store.cc:276] 0201 09:00:07.926331 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.927074 (+ 743us) service_pool.cc:225] Handling call
0201 09:00:07.948751 (+ 21677us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:08.537665 (+588914us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.338548 (+800883us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b540062f054. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023aa81 00007f74b02394be 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786
0201 09:00:09.338699 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1325752064}
I20260201 09:00:09.342841 18743 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:09.311127 19211 raft_consensus.cc:2804] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:09.336575 19182 consensus_queue.cc:1048] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260201 09:00:09.313575 19186 raft_consensus.cc:515] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.315076 18569 raft_consensus.cc:515] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:09.347258 19127 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.350101 19073 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:09.348882 17211 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 356) took 1528 ms. Trace:
I20260201 09:00:09.337307 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45886 (request call id 776) took 1609 ms. Trace:
I20260201 09:00:09.341624 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 573) took 1482 ms. Trace:
I20260201 09:00:09.370146 17204 rpcz_store.cc:276] 0201 09:00:07.859367 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.332968 (+1473601us) service_pool.cc:225] Handling call
0201 09:00:09.333331 (+ 363us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.341380 (+ 8049us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.341572 (+ 192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.371585 17202 rpcz_store.cc:276] 0201 09:00:07.728261 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.307901 (+1579640us) service_pool.cc:225] Handling call
0201 09:00:09.309316 (+ 1415us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.337065 (+ 27749us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.337256 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.326819 18828 raft_consensus.cc:2749] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260201 09:00:09.373157 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 45958.7us
I20260201 09:00:09.332156 18989 raft_consensus.cc:697] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
W20260201 09:00:09.359087 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 105403us
I20260201 09:00:09.347506 19165 leader_election.cc:290] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
W20260201 09:00:09.337215 17791 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:09.363853 17102 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:09.379686 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b057fd1bf2ef435ab6dcce60b1e45e10" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.380671 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.381510 17202 raft_consensus.cc:1275] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260201 09:00:09.381950 17202 pending_rounds.cc:85] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Aborting all ops after (but not including) 1
I20260201 09:00:09.382171 17202 pending_rounds.cc:107] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260201 09:00:09.382398 17202 raft_consensus.cc:2889] T dc19ac6347fa40b7b6d2c6912c975575 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:09.383083 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 359) took 1464 ms. Trace:
I20260201 09:00:09.383401 17202 rpcz_store.cc:276] 0201 09:00:07.918670 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.372413 (+1453743us) service_pool.cc:225] Handling call
0201 09:00:09.379367 (+ 6954us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.382826 (+ 3459us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.383027 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.337519 17208 rpcz_store.cc:276] 0201 09:00:07.811533 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.309959 (+1498426us) service_pool.cc:225] Handling call
0201 09:00:09.310226 (+ 267us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.310381 (+ 155us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.310405 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.310444 (+ 39us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:09.310471 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.310519 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.310616 (+ 97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.331202 19100 consensus_queue.cc:260] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:09.360159 19121 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:09.353561 17206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 582) took 1491 ms. Trace:
I20260201 09:00:09.372833 17211 rpcz_store.cc:276] 0201 09:00:07.820259 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.313327 (+1493068us) service_pool.cc:225] Handling call
0201 09:00:09.336681 (+ 23354us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.336843 (+ 162us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.348570 (+ 11727us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.348628 (+ 58us) raft_consensus.cc:1645] Marking committed up to 5
0201 09:00:09.348660 (+ 32us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.348716 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.348811 (+ 95us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.374521 17101 leader_election.cc:304] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:09.375345 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.399761 17206 rpcz_store.cc:276] 0201 09:00:07.861809 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.336305 (+1474496us) service_pool.cc:225] Handling call
0201 09:00:09.353121 (+ 16816us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.353287 (+ 166us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.353310 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.353347 (+ 37us) raft_consensus.cc:1645] Marking committed up to 3
0201 09:00:09.353375 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.353423 (+ 48us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.353512 (+ 89us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.352551 19090 raft_consensus.cc:697] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:09.376219 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:09.402272 17204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 362) took 1264 ms. Trace:
I20260201 09:00:09.368661 18956 consensus_queue.cc:1059] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260201 09:00:09.387058 19085 consensus_queue.cc:1059] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:09.387249 19186 leader_election.cc:290] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:09.388098 17842 raft_consensus.cc:1240] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:09.389492 18569 leader_election.cc:290] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:09.366806 19132 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.370903 19211 raft_consensus.cc:697] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 6 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:09.394060 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d454a89732b54703b564e1c647bbb335" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.371279 19127 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Advancing to term 9
I20260201 09:00:09.396456 17175 leader_election.cc:400] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6.
I20260201 09:00:09.397853 19036 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:09.355011 17205 rpcz_store.cc:276] 0201 09:00:07.824770 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.314922 (+1490152us) service_pool.cc:225] Handling call
0201 09:00:09.335860 (+ 20938us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.350810 (+ 14950us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.351965 (+ 1155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.352018 (+ 53us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:09.352060 (+ 42us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.352124 (+ 64us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.352237 (+ 113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.402201 17250 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
W20260201 09:00:09.421308 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 57555.4us
I20260201 09:00:09.422402 17250 leader_election.cc:304] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.422916 17102 leader_election.cc:304] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.423506 17250 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.377399 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:09.403402 17204 rpcz_store.cc:276] 0201 09:00:08.137806 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.400651 (+1262845us) service_pool.cc:225] Handling call
0201 09:00:09.401833 (+ 1182us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.401992 (+ 159us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.402015 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.402054 (+ 39us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:09.402082 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.402134 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.402227 (+ 93us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.427332 17204 raft_consensus.cc:1240] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260201 09:00:09.404161 17208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 361) took 1442 ms. Trace:
I20260201 09:00:09.405894 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:09.406430 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 84464.2us
I20260201 09:00:09.407572 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:09.408784 17285 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54622 (request call id 859) took 1666 ms. Trace:
I20260201 09:00:09.411332 17202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 360) took 1481 ms. Trace:
I20260201 09:00:09.411908 17101 leader_election.cc:304] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
W20260201 09:00:09.415647 17209 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45884 (request call id 581) took 1554 ms (client timeout 1620 ms). Trace:
I20260201 09:00:09.416149 17175 leader_election.cc:403] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260201 09:00:09.399068 19194 leader_election.cc:290] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:09.425717 18847 consensus_queue.cc:1048] T dc19ac6347fa40b7b6d2c6912c975575 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260201 09:00:09.429024 19075 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:09.434266 19075 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:09.434623 19075 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:09.434906 18847 raft_consensus.cc:3055] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:09.435341 18847 raft_consensus.cc:740] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:09.429167 19192 raft_consensus.cc:2749] T 68c080f2c06d4219bdb2e4a546153bc4 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:09.439700 19087 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.440158 17250 leader_election.cc:304] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.426247 19036 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:09.441947 17250 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:09.443084 17280 raft_consensus.cc:1240] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 2. Current term is 3. Ops: []
I20260201 09:00:09.444528 19194 raft_consensus.cc:2749] T 8f36c29f280a42faa270584136681eda P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.445264 19099 raft_consensus.cc:3055] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:09.445698 19099 raft_consensus.cc:740] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:09.445770 19211 consensus_queue.cc:237] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.446277 18539 consensus_queue.cc:1059] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:09.446501 19099 consensus_queue.cc:260] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:09.447832 18539 raft_consensus.cc:3055] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Stepping down as leader of term 2
I20260201 09:00:09.448166 18539 raft_consensus.cc:740] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:09.417980 18953 raft_consensus.cc:2804] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:09.453749 18539 consensus_queue.cc:260] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:09.454118 19090 consensus_queue.cc:237] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:09.455264 18539 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 2 FOLLOWER]: Advancing to term 3
I20260201 09:00:09.406430 19182 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:09.457259 19182 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.457682 19182 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
W20260201 09:00:09.458112 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 61815.5us
I20260201 09:00:09.460719 18969 raft_consensus.cc:2749] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6.
I20260201 09:00:09.461068 19165 consensus_queue.cc:1059] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:09.461694 18969 consensus_queue.cc:1059] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:09.462097 19165 raft_consensus.cc:3055] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:09.429391 17202 rpcz_store.cc:276] 0201 09:00:07.930015 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.384191 (+1454176us) service_pool.cc:225] Handling call
0201 09:00:09.410962 (+ 26771us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.411103 (+ 141us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.411122 (+ 19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.411154 (+ 32us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:09.411181 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.411225 (+ 44us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.411294 (+ 69us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.427706 17208 rpcz_store.cc:276] 0201 09:00:07.962243 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.403367 (+1441124us) service_pool.cc:225] Handling call
0201 09:00:09.403695 (+ 328us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.403863 (+ 168us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.403889 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.403931 (+ 42us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:09.403960 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.404010 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.404108 (+ 98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.428336 17285 rpcz_store.cc:276] 0201 09:00:07.742760 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.817589 (+ 74829us) service_pool.cc:225] Handling call
0201 09:00:08.980158 (+1162569us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.095381 (+115223us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.408576 (+313195us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000a05d0. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a35a1 00007f74b023952d 00007f74b51edf49 00007f74ae77ad34 00007f74ae77acc2 00007f74ae77abf1 00007f74ae77ab6c 00007f74ae779e22 00007f74ae57934c 00007f74ae578786 00007f74ae57812f
0201 09:00:09.408715 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2661690240}
I20260201 09:00:09.430620 17279 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
W20260201 09:00:09.429808 17209 rpcz_store.cc:269] 0201 09:00:07.861541 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:07.874621 (+ 13080us) service_pool.cc:225] Handling call
0201 09:00:09.393864 (+1519243us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 09:00:09.415568 (+ 21704us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":58802560}
I20260201 09:00:09.450651 19132 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:09.451910 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.453522 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10f95c4a674b4c4a8df3ea0869c9b4da" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.429778 17207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45886 (request call id 788) took 1310 ms. Trace:
I20260201 09:00:09.462530 19165 raft_consensus.cc:740] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:09.429998 18956 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.467960 17207 rpcz_store.cc:276] 0201 09:00:08.119058 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:08.631149 (+512091us) service_pool.cc:225] Handling call
0201 09:00:09.407433 (+776284us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b58001e3098. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad14edb1 00007f74ad14ec62 00007f74b5ff9dd9 00007f74b5179260 00007f74b5241dbb 00007f74b5241e41 00007f74b51efbd0 00007f74b51ef4b4 00007f74ae77f834 00007f74ae77f7c2
0201 09:00:09.429724 (+ 22291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6825344}
I20260201 09:00:09.443006 17250 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.470289 17250 leader_election.cc:304] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.471493 17250 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:09.414973 19100 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:09.472574 14089 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260201 09:00:09.468004 17846 raft_consensus.cc:2376] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4. Re-sending same reply.
I20260201 09:00:09.462617 18969 raft_consensus.cc:3055] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:09.486665 18969 raft_consensus.cc:740] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:09.487520 18811 leader_election.cc:290] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:09.487524 18969 consensus_queue.cc:260] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.399057 19143 consensus_queue.cc:1059] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260201 09:00:09.445310 19194 raft_consensus.cc:2804] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:09.488927 18969 raft_consensus.cc:3060] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:09.489441 19194 raft_consensus.cc:493] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.489823 19194 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:09.490145 19143 raft_consensus.cc:3055] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:09.490619 19143 raft_consensus.cc:740] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:09.491384 19143 consensus_queue.cc:260] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:09.494938 19132 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.495522 19132 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:09.496593 18989 consensus_queue.cc:237] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.497488 19132 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:09.442970 19036 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:09.500792 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.502604 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
W20260201 09:00:09.503175 17251 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:09.504390 19192 raft_consensus.cc:2749] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260201 09:00:09.506124 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 83280us
I20260201 09:00:09.436162 18847 consensus_queue.cc:260] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:09.506791 17102 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:09.521149 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:09.492692 19143 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
W20260201 09:00:09.523865 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 112046us
W20260201 09:00:09.522893 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 51501.4us
W20260201 09:00:09.503216 19223 log.cc:927] Time spent T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.089s user 0.003s sys 0.000s
I20260201 09:00:09.530881 17101 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:09.524384 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 95676.3us
I20260201 09:00:09.532352 17103 leader_election.cc:304] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:09.526960 17250 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:09.477232 19087 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:09.535750 18847 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:09.534726 17250 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.536705 19132 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:09.537037 18968 raft_consensus.cc:2804] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:09.518795 19124 raft_consensus.cc:2749] T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:09.542532 17101 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:09.543231 17102 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:09.538971 19053 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:09.504985 17203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45106 (request call id 358) took 1597 ms. Trace:
I20260201 09:00:09.544852 17250 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.514020 19099 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:09.525889 18811 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:09.563298 17794 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.566943 19210 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:09.567386 19210 raft_consensus.cc:493] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:09.567744 19210 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
W20260201 09:00:09.574882 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:09.550055 19192 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:09.577271 19192 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.576948 19210 raft_consensus.cc:515] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.577679 19192 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:09.579836 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:09.550577 19225 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.583042 19210 leader_election.cc:290] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:09.583395 19124 consensus_queue.cc:1059] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:09.554195 19053 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.584668 19053 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:09.586807 18956 raft_consensus.cc:2749] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:09.556232 17203 rpcz_store.cc:276] 0201 09:00:07.907309 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.353584 (+1446275us) service_pool.cc:225] Handling call
0201 09:00:09.373368 (+ 19784us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.404709 (+ 31341us) raft_consensus.cc:1534] Early marking committed up to index 0
0201 09:00:09.412949 (+ 8240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.414918 (+ 1969us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:09.420288 (+ 5370us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.427074 (+ 6786us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.477802 (+ 50728us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260201 09:00:09.559640 18811 raft_consensus.cc:493] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:09.594091 18811 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:09.595752 19226 raft_consensus.cc:3055] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:09.596197 19226 raft_consensus.cc:740] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:09.525955 18953 raft_consensus.cc:697] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:09.596966 19226 consensus_queue.cc:260] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.597456 18953 consensus_queue.cc:237] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:09.567087 19221 log.cc:927] Time spent T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.153s user 0.001s sys 0.000s
I20260201 09:00:09.563971 19087 raft_consensus.cc:2749] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.606637 19165 consensus_queue.cc:260] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.607700 19165 raft_consensus.cc:3060] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:09.556571 19196 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:09.612460 17842 raft_consensus.cc:1240] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260201 09:00:09.478686 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260201 09:00:09.635162 17248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:09.633533 16955 catalog_manager.cc:5654] T 4f1aa904185346f688e8877d1046ed2e P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 09:00:09.639796 16955 catalog_manager.cc:5654] T aec9b4feb0a8410c98176562346a7ca9 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 09:00:09.583010 19225 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:09.638837 17210 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45884 (request call id 568) took 1804 ms. Trace:
I20260201 09:00:09.642148 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:09.644223 17279 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
W20260201 09:00:09.646109 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:09.615135 19196 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:09.572392 19182 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.641211 16955 catalog_manager.cc:5654] T b057fd1bf2ef435ab6dcce60b1e45e10 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 7, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 7 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 09:00:09.655308 16955 catalog_manager.cc:5654] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 4 to 6, leader changed from 35484ac93d564e958f85965bd740a18f (127.13.194.65) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 6 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:09.659613 16955 catalog_manager.cc:5654] T 927294866f7f46cb8fa5ddd1ad31b2a9 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 4, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 09:00:09.665977 19194 raft_consensus.cc:515] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.567636 19127 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.663424 17279 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:09.666927 17285 raft_consensus.cc:1240] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:09.668157 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:09.666723 19182 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:09.669971 17794 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.675352 16957 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34906 (request call id 60) took 10281 ms. Trace:
I20260201 09:00:09.654289 19196 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:09.684356 17280 raft_consensus.cc:1240] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:09.675830 16957 rpcz_store.cc:276] 0201 08:59:59.417918 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 08:59:59.428409 (+ 10491us) service_pool.cc:225] Handling call
0201 08:59:59.853379 (+424970us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b540008f554. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74b01a40c0 00007f74b0242bba 00007f74b5fc3eac 00007f74b60be10e 00007f74b45b94a4 00007f74b45b9432 00007f74b45b9361 00007f74b45b92dc 00007f74b45b8592 00007f74ae57934c 00007f74ae578786
0201 09:00:09.675293 (+9821914us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 09:00:04.783105 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 09:00:04.783684 (+ 579us) write_op.cc:432] Acquiring schema lock in shared mode
0201 09:00:04.783720 (+ 36us) write_op.cc:435] Acquired schema lock
0201 09:00:04.783738 (+ 18us) tablet.cc:660] Decoding operations
0201 09:00:04.784655 (+ 917us) write_op.cc:620] Acquiring the partition lock for write op
0201 09:00:04.784731 (+ 76us) write_op.cc:641] Partition lock acquired for write op
0201 09:00:04.784760 (+ 29us) tablet.cc:683] Acquiring locks for 8 operations
0201 09:00:04.943273 (+158513us) tablet.cc:699] Row locks acquired
0201 09:00:04.945828 (+ 2555us) write_op.cc:260] PREPARE: finished
0201 09:00:04.963689 (+ 17861us) write_op.cc:270] Start()
0201 09:00:04.966906 (+ 3217us) write_op.cc:276] Timestamp: P: 1769936404961884 usec, L: 0
0201 09:00:04.968613 (+ 1707us) op_driver.cc:348] REPLICATION: starting
0201 09:00:05.036380 (+ 67767us) log.cc:844] Serialized 3257 byte log entry
0201 09:00:06.881642 (+1845262us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74afdd4c0e 00007f74afdd3f56 00007f74afdd3b78 00007f74afddd5c1 00007f74afddd579 00007f74afddd509
0201 09:00:07.357942 (+476300us) op_driver.cc:464] REPLICATION: finished
0201 09:00:07.840898 (+482956us) write_op.cc:301] APPLY: starting
0201 09:00:07.841004 (+ 106us) tablet.cc:1365] starting BulkCheckPresence
0201 09:00:07.841174 (+ 170us) tablet.cc:1368] finished BulkCheckPresence
0201 09:00:07.841191 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 09:00:07.842109 (+ 918us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 09:00:07.842304 (+ 195us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0201 09:00:07.842345 (+ 41us) write_op.cc:312] APPLY: finished
0201 09:00:07.842601 (+ 256us) log.cc:844] Serialized 64 byte log entry
0201 09:00:07.843329 (+ 728us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:07.843455 (+ 126us) write_op.cc:454] Released schema lock
0201 09:00:07.843497 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0201 09:00:07.851663 (+ 8166us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:07.851697 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62990,"reported_tablets":28,"spinlock_wait_cycles":31657344,"child_traces":[["op",{"apply.queue_time_us":453823,"apply.run_cpu_time_us":2463,"apply.run_wall_time_us":17946,"num_ops":8,"prepare.queue_time_us":100991,"prepare.run_cpu_time_us":12828,"prepare.run_wall_time_us":451563,"raft.queue_time_us":161547,"raft.run_cpu_time_us":31573,"raft.run_wall_time_us":260996,"replication_time_us":2389150,"spinlock_wait_cycles":5375232,"thread_start_us":499351,"threads_started":4,"wal-append.queue_time_us":269014,"wal-append.run_cpu_time_us":39087,"wal-append.run_wall_time_us":3528401}]]}
I20260201 09:00:09.683904 19074 raft_consensus.cc:2804] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:09.711202 19074 raft_consensus.cc:697] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:09.717264 19194 leader_election.cc:290] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:09.718708 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:09.723898 16955 catalog_manager.cc:5654] T ef3dae7e71e447b79f434ce7b1684707 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 09:00:09.704424 19075 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
W20260201 09:00:09.738569 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 193766us
I20260201 09:00:09.743171 18968 raft_consensus.cc:697] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:09.749127 16955 catalog_manager.cc:5654] T b58ae14986de4b32bbd4ae3d2b530783 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
W20260201 09:00:09.748040 17103 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 216049us
I20260201 09:00:09.642243 17210 rpcz_store.cc:276] 0201 09:00:07.834591 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:09.317184 (+1482593us) service_pool.cc:225] Handling call
0201 09:00:09.337532 (+ 20348us) raft_consensus.cc:1471] Updating replica for 0 ops
0201 09:00:09.337736 (+ 204us) raft_consensus.cc:1534] Early marking committed up to index 4
0201 09:00:09.404761 (+ 67025us) log.cc:844] Serialized 14 byte log entry
0201 09:00:09.638494 (+233733us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0201 09:00:09.638553 (+ 59us) raft_consensus.cc:1645] Marking committed up to 4
0201 09:00:09.638592 (+ 39us) raft_consensus.cc:1697] Filling consensus response to leader.
0201 09:00:09.638651 (+ 59us) raft_consensus.cc:1691] UpdateReplicas() finished
0201 09:00:09.638781 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":53056,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":3835,"thread_start_us":296376,"threads_started":2}
I20260201 09:00:09.750866 17250 leader_election.cc:304] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
W20260201 09:00:09.760335 17101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 208204us
I20260201 09:00:09.766351 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 09:00:09.767130 17103 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:09.768925 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:09.766224 16955 catalog_manager.cc:5654] T 2c4343ae3470408987d247c06337e0a5 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 4, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 09:00:09.770128 16955 catalog_manager.cc:5654] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 4 to 8, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 8 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } }
I20260201 09:00:09.771552 16955 catalog_manager.cc:5654] T c3d3eb882b354a0089a1a129ce4be4c1 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:09.774700 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1aa904185346f688e8877d1046ed2e" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:09.775969 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:09.776787 17130 raft_consensus.cc:2393] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:09.780793 19127 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 9 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:09.780691 18814 consensus_queue.cc:1059] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260201 09:00:09.782552 19090 consensus_queue.cc:1059] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:09.783216 19090 consensus_queue.cc:1243] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer f5398ba4a58b40ca9b78a210cdb7ae4d log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260201 09:00:09.783792 19211 raft_consensus.cc:3055] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Stepping down as leader of term 7
I20260201 09:00:09.780424 18968 consensus_queue.cc:237] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:09.784121 19211 raft_consensus.cc:740] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:09.785004 19211 consensus_queue.cc:260] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.789767 17250 leader_election.cc:304] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:09.790688 19236 raft_consensus.cc:2749] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:09.792896 17285 raft_consensus.cc:1240] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:09.795966 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:09.798673 17248 leader_election.cc:304] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:09.799796 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:09.804800 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7a634ccefb24b158e97cff94318758f" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:09.810940 17132 raft_consensus.cc:1240] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 9 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 8. Current term is 9. Ops: []
I20260201 09:00:09.810770 16955 catalog_manager.cc:5654] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 2, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 2 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:09.812418 16955 catalog_manager.cc:5654] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 09:00:09.814110 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:09.818881 17282 raft_consensus.cc:2393] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:09.814818 19036 raft_consensus.cc:2749] T 4f1aa904185346f688e8877d1046ed2e P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:09.779625 19132 raft_consensus.cc:2749] T 6af74496ca1949d78f5a2a08f5cb9635 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:09.839197 16955 catalog_manager.cc:5654] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 1 to 2, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 2 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 09:00:09.750905 19121 raft_consensus.cc:515] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:09.843921 16955 catalog_manager.cc:5654] T c6883c591b5547018eba339947c179ce P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 09:00:09.854053 16955 catalog_manager.cc:5654] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 3 to 6, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 6 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 09:00:09.859006 16955 catalog_manager.cc:5654] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 4 to 5, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 5 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 09:00:09.860849 16955 catalog_manager.cc:5654] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 reported cstate change: term changed from 2 to 3, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 3 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } }
I20260201 09:00:09.866233 17282 raft_consensus.cc:1240] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:09.757407 19074 consensus_queue.cc:237] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
W20260201 09:00:09.879456 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 336266us
I20260201 09:00:09.880191 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:09.814811 18989 consensus_queue.cc:1059] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260201 09:00:09.883198 17282 raft_consensus.cc:1240] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [term 6 LEADER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:09.870203 19211 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:09.886943 17102 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:09.888223 17130 raft_consensus.cc:1275] T 646f532b2c434b56b4efba4e815711a7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260201 09:00:09.932374 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 47069.4us
W20260201 09:00:09.932507 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 45625.8us
W20260201 09:00:09.935354 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 47483.1us
I20260201 09:00:09.872457 19196 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:09.932828 19218 log.cc:927] Time spent T dc19ac6347fa40b7b6d2c6912c975575 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260201 09:00:09.943629 17102 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:09.947432 17282 raft_consensus.cc:1240] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:09.949383 17128 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260201 09:00:09.941265 19075 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:09.934866 19240 raft_consensus.cc:2749] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 09:00:09.949092 19239 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P 3dee892ea94d4f2a92316ad6f79edca2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260201 09:00:09.973780 19235 log.cc:927] Time spent T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.131s user 0.000s sys 0.000s
I20260201 09:00:09.974395 19241 raft_consensus.cc:493] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:10.006335 17132 raft_consensus.cc:1240] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 3. Current term is 4. Ops: []
I20260201 09:00:10.006559 19241 raft_consensus.cc:515] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:09.976744 19085 consensus_queue.cc:1059] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260201 09:00:09.978991 19226 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:09.993430 17282 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85f87e31da9e48ee853c4246adc1a1a2" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.004266 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ef3dae7e71e447b79f434ce7b1684707" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.012933 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:09.936815 19192 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.018397 19241 leader_election.cc:290] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:10.019186 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4061439a0974c4d87b3541e46a95fc7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.025004 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.025758 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:10.024797 19075 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260201 09:00:10.030220 18501 consensus_queue.cc:1059] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260201 09:00:10.030933 19233 log.cc:927] Time spent T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c: Append to log took a long time: real 0.149s user 0.000s sys 0.000s
W20260201 09:00:10.019862 19234 log.cc:927] Time spent T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.078s user 0.001s sys 0.000s
I20260201 09:00:10.048159 17276 raft_consensus.cc:1240] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 7. Current term is 8. Ops: []
W20260201 09:00:10.030418 19230 log.cc:927] Time spent T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
I20260201 09:00:10.058230 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.012108 19053 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:10.070218 19067 raft_consensus.cc:3055] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:10.072171 19067 raft_consensus.cc:740] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:10.073025 19067 consensus_queue.cc:260] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.074110 19053 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
W20260201 09:00:10.075369 19243 log.cc:927] Time spent T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
I20260201 09:00:10.076205 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
W20260201 09:00:10.078274 19143 consensus_meta.cc:287] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Time spent flushing consensus metadata: real 0.547s user 0.008s sys 0.001s
I20260201 09:00:10.078948 17847 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:10.079864 17210 raft_consensus.cc:1275] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260201 09:00:10.080242 17210 pending_rounds.cc:85] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Aborting all ops after (but not including) 2
I20260201 09:00:10.080442 17210 pending_rounds.cc:107] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260201 09:00:10.064903 19121 leader_election.cc:290] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
W20260201 09:00:10.082450 19099 consensus_meta.cc:287] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2: Time spent flushing consensus metadata: real 0.524s user 0.008s sys 0.000s
I20260201 09:00:10.083245 19073 consensus_queue.cc:1059] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:10.084235 19073 raft_consensus.cc:3055] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 7 LEADER]: Stepping down as leader of term 7
I20260201 09:00:10.084578 19073 raft_consensus.cc:740] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:10.101704 19073 consensus_queue.cc:260] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.103168 19073 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:10.053900 19186 raft_consensus.cc:3055] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:10.103677 19186 raft_consensus.cc:740] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:10.105260 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:10.108726 17276 raft_consensus.cc:2410] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260201 09:00:10.097844 19067 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.098481 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:10.099545 17282 raft_consensus.cc:1240] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:10.085268 18847 raft_consensus.cc:3055] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:10.110594 18847 raft_consensus.cc:740] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:10.111428 18847 consensus_queue.cc:260] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.112592 18847 raft_consensus.cc:3060] T 08d6f47dbb384bb29b5d6f97211bcdfc P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:10.089046 19196 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.104955 19210 raft_consensus.cc:3055] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 8 LEADER]: Stepping down as leader of term 8
I20260201 09:00:10.113463 19210 raft_consensus.cc:740] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:10.114310 19210 consensus_queue.cc:260] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:10.106341 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bad6ae52daf4b8bba5e450dbee00fe0" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.107524 19186 consensus_queue.cc:260] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.090801 17280 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:10.080660 17210 raft_consensus.cc:2889] T 646f532b2c434b56b4efba4e815711a7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 09:00:10.118278 19196 raft_consensus.cc:493] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5398ba4a58b40ca9b78a210cdb7ae4d)
I20260201 09:00:10.118853 19196 raft_consensus.cc:515] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.109571 17277 raft_consensus.cc:1240] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7. Ops: []
W20260201 09:00:10.097934 18811 consensus_meta.cc:287] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c: Time spent flushing consensus metadata: real 0.503s user 0.009s sys 0.000s
I20260201 09:00:10.092952 19192 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.118357 17103 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.120944 18811 raft_consensus.cc:515] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.122287 17279 raft_consensus.cc:1240] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 6. Current term is 7. Ops: []
I20260201 09:00:10.123036 19099 raft_consensus.cc:2749] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260201 09:00:10.123739 19099 consensus_queue.cc:1059] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:10.124285 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.124554 19225 raft_consensus.cc:3055] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:10.125017 19225 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:10.120776 19196 leader_election.cc:290] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:10.125804 19225 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.127063 19225 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.129074 18847 consensus_queue.cc:1059] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 09:00:10.106835 17283 raft_consensus.cc:1240] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 7. Current term is 8. Ops: []
I20260201 09:00:10.131368 18811 leader_election.cc:290] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.134174 18847 raft_consensus.cc:3055] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:10.137104 18847 raft_consensus.cc:740] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:10.139441 18847 consensus_queue.cc:260] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.144659 18847 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
W20260201 09:00:10.161548 17793 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 214681us
W20260201 09:00:10.165810 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 190977us
I20260201 09:00:10.169693 17845 raft_consensus.cc:1240] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [term 6 LEADER]: Rejecting Update request from peer f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6. Ops: []
I20260201 09:00:10.171603 17210 raft_consensus.cc:1275] T 2c3c8e7e03764c049810ad470ab313c7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:10.176260 17134 raft_consensus.cc:1240] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Rejecting Update request from peer 35484ac93d564e958f85965bd740a18f for earlier term 4. Current term is 5. Ops: []
I20260201 09:00:10.185794 17842 raft_consensus.cc:1275] T 22ea6a68454747bf8c2fb8b0af084d3a P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:10.187610 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:10.189244 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:10.193401 17249 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.193425 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:10.194360 19192 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:10.194742 19192 raft_consensus.cc:493] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:10.195134 19192 raft_consensus.cc:3060] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
W20260201 09:00:10.199265 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 201675us
W20260201 09:00:10.200212 17177 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:10.196224 19194 consensus_queue.cc:1048] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.004s
I20260201 09:00:10.204053 17177 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.182449 19209 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260201 09:00:10.218302 19083 consensus_queue.cc:1048] T 646f532b2c434b56b4efba4e815711a7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:10.219018 19210 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Advancing to term 9
I20260201 09:00:10.223299 17845 raft_consensus.cc:1275] T 5373f77eaf6a488faf35417ffdaa32b3 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:10.203545 18969 consensus_queue.cc:1059] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260201 09:00:10.224993 19226 consensus_queue.cc:1048] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:10.225956 18969 raft_consensus.cc:3055] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Stepping down as leader of term 6
I20260201 09:00:10.226342 18969 raft_consensus.cc:740] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
W20260201 09:00:10.229460 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 209886us
I20260201 09:00:10.230178 17174 leader_election.cc:304] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.232688 18828 consensus_queue.cc:1048] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:10.233495 18501 raft_consensus.cc:2749] T b057fd1bf2ef435ab6dcce60b1e45e10 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:10.234680 19186 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:10.235208 17174 leader_election.cc:304] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.227408 19165 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:10.236963 18969 consensus_queue.cc:260] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.238327 18969 raft_consensus.cc:3060] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.236770 18501 raft_consensus.cc:2749] T a3beb95bbbb64b4485bc29a00f4c7854 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260201 09:00:10.212404 19073 consensus_queue.cc:1059] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260201 09:00:10.259354 17134 raft_consensus.cc:1275] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:10.245929 17174 leader_election.cc:400] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for earlier term 5. Current term is 6.
I20260201 09:00:10.263216 17842 raft_consensus.cc:2468] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:10.247763 17846 raft_consensus.cc:2468] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 8.
I20260201 09:00:10.228191 18569 consensus_queue.cc:1059] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260201 09:00:10.266011 19073 raft_consensus.cc:3055] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Stepping down as leader of term 4
I20260201 09:00:10.265013 17249 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:10.284792 17249 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:10.285849 18811 raft_consensus.cc:2804] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:10.286338 18811 raft_consensus.cc:697] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:10.287165 18811 consensus_queue.cc:237] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.271821 19073 raft_consensus.cc:740] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:10.276554 19194 raft_consensus.cc:2804] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Leader election won for term 8
I20260201 09:00:10.299433 18743 consensus_queue.cc:1048] T 2c3c8e7e03764c049810ad470ab313c7 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260201 09:00:10.311713 19186 consensus_queue.cc:1059] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260201 09:00:10.314159 19194 raft_consensus.cc:697] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [term 8 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:10.318802 19073 consensus_queue.cc:260] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
W20260201 09:00:10.334223 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 128856us
I20260201 09:00:10.334415 17276 raft_consensus.cc:1275] T 10f95c4a674b4c4a8df3ea0869c9b4da P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:10.335101 17177 leader_election.cc:304] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:10.336277 17100 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260201 09:00:10.344110 19261 raft_consensus.cc:2749] T c7a634ccefb24b158e97cff94318758f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:10.344568 17177 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.317973 19186 consensus_queue.cc:1243] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer 35484ac93d564e958f85965bd740a18f log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260201 09:00:10.315711 19192 raft_consensus.cc:515] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.350646 19257 raft_consensus.cc:2749] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260201 09:00:10.365231 18969 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:10.371186 18969 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.372363 17128 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260201 09:00:10.372097 18501 consensus_queue.cc:1059] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:10.373227 18969 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:10.389657 19211 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:10.391645 19261 consensus_queue.cc:1059] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:10.393987 19073 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:10.351207 19196 consensus_queue.cc:1048] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260201 09:00:10.354635 19194 consensus_queue.cc:237] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.409735 17177 leader_election.cc:304] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
W20260201 09:00:10.437608 17177 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 62773.6us
I20260201 09:00:10.438325 17177 leader_election.cc:304] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.439570 19268 raft_consensus.cc:2749] T 85f87e31da9e48ee853c4246adc1a1a2 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:10.440382 19257 raft_consensus.cc:2749] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:10.439591 17177 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.445217 18569 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:10.446624 17134 raft_consensus.cc:1240] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260201 09:00:10.448669 19250 raft_consensus.cc:3055] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Stepping down as leader of term 5
I20260201 09:00:10.449162 19250 raft_consensus.cc:740] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:10.450011 17177 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.453831 18569 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260201 09:00:10.454321 19254 consensus_queue.cc:1059] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:10.455849 19254 raft_consensus.cc:3055] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 LEADER]: Stepping down as leader of term 7
I20260201 09:00:10.456310 19254 raft_consensus.cc:740] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:10.457518 19254 consensus_queue.cc:260] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.460747 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.462250 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "633da6e0243e4ed295549ef2f930e78d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.466969 17177 leader_election.cc:304] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.468032 19261 raft_consensus.cc:2749] T 633da6e0243e4ed295549ef2f930e78d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:10.449956 19250 consensus_queue.cc:260] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.473693 19250 raft_consensus.cc:3060] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:10.464845 18811 consensus_queue.cc:1059] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260201 09:00:10.478096 19192 leader_election.cc:290] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:10.480938 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:10.476675 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2d7b23e195941c5a5d351fc04a2a64d" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:10.481736 17134 raft_consensus.cc:2393] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 4: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:10.488932 17842 raft_consensus.cc:2468] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:10.490618 17249 leader_election.cc:304] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.491695 19194 raft_consensus.cc:2804] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:10.492148 19194 raft_consensus.cc:697] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [term 4 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:10.483232 19254 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:10.493623 17845 raft_consensus.cc:1275] T 10f95c4a674b4c4a8df3ea0869c9b4da P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:10.492929 19194 consensus_queue.cc:237] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.498557 17134 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:10.500586 18811 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:10.502799 19165 raft_consensus.cc:3055] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Stepping down as leader of term 3
I20260201 09:00:10.503224 19165 raft_consensus.cc:740] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:10.503970 19165 consensus_queue.cc:260] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.495087 19099 consensus_queue.cc:1048] T 10f95c4a674b4c4a8df3ea0869c9b4da P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260201 09:00:10.506057 19182 raft_consensus.cc:3055] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Stepping down as leader of term 7
I20260201 09:00:10.506433 19182 raft_consensus.cc:740] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:10.507225 19182 consensus_queue.cc:260] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.550508 19182 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:10.556217 17283 raft_consensus.cc:1275] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260201 09:00:10.560328 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 288382us
I20260201 09:00:10.561827 17174 leader_election.cc:304] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.562650 19250 raft_consensus.cc:2749] T ef3dae7e71e447b79f434ce7b1684707 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:10.563848 17174 leader_election.cc:304] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.550541 19226 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:10.564630 19250 raft_consensus.cc:2749] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260201 09:00:10.564960 19226 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.565999 17174 leader_election.cc:304] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.566954 19226 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:10.571997 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.572683 17283 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:10.573712 19254 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:10.574193 19254 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.575551 17103 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:10.567126 19165 raft_consensus.cc:3060] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:10.578080 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "22ea6a68454747bf8c2fb8b0af084d3a" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:10.578455 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4fc35bc514f47bc8de1d20b274d3416" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:10.579231 17206 raft_consensus.cc:2468] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:10.580298 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.581414 17137 raft_consensus.cc:2410] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260201 09:00:10.581552 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08be66650c334ab1b9d801bb366c9969" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.581624 17205 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08d6f47dbb384bb29b5d6f97211bcdfc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.583271 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c8a318ae314c74b860cee66450033c" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.583525 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.584786 17206 raft_consensus.cc:1275] T 22ea6a68454747bf8c2fb8b0af084d3a P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:10.585100 17203 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:10.585726 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.586251 17210 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.590112 17209 raft_consensus.cc:2468] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 8.
I20260201 09:00:10.591115 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.577726 19250 raft_consensus.cc:2749] T e4061439a0974c4d87b3541e46a95fc7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260201 09:00:10.593411 17207 raft_consensus.cc:1275] T ce4e1322b3134c60b0641a8941a7f76e P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260201 09:00:10.594343 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d3235b5e3846929a4eeb9edb554d85" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:10.579025 19099 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:10.595441 17204 raft_consensus.cc:2468] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:10.594825 17210 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:10.591652 19226 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:10.588981 18811 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:10.599321 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.602034 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.602808 17283 raft_consensus.cc:2410] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260201 09:00:10.603639 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c3c8e7e03764c049810ad470ab313c7" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
W20260201 09:00:10.605451 17790 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 46749.7us
I20260201 09:00:10.606159 17211 raft_consensus.cc:1240] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Rejecting Update request from peer 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260201 09:00:10.599180 19226 raft_consensus.cc:493] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:10.607204 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.598331 19099 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
W20260201 09:00:10.608633 17794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.68:45925, user_credentials={real_user=slave}} blocked reactor thread for 47090.9us
I20260201 09:00:10.609861 19143 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:10.610451 19099 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.611006 19073 consensus_queue.cc:1048] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260201 09:00:10.611676 19276 log.cc:927] Time spent T ce4e1322b3134c60b0641a8941a7f76e P 3dee892ea94d4f2a92316ad6f79edca2: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260201 09:00:10.600284 18811 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.613819 18811 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:10.616287 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.617182 17128 raft_consensus.cc:2393] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c in current term 6: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:10.617522 17207 raft_consensus.cc:1275] T 01d3235b5e3846929a4eeb9edb554d85 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:10.619237 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:10.619835 17846 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 6.
I20260201 09:00:10.620702 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:10.607203 19226 raft_consensus.cc:3060] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:10.625844 18828 consensus_queue.cc:1048] T 01d3235b5e3846929a4eeb9edb554d85 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:10.620667 18871 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:10.627434 18871 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.629294 18871 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:10.601023 19254 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:10.631757 17249 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.633930 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.635535 17283 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:10.634392 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.636502 17137 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 6.
I20260201 09:00:10.640520 17103 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:10.644505 17790 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:10.646667 18539 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:10.646718 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.647121 18539 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:10.647337 18953 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:10.647825 18953 raft_consensus.cc:493] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:10.648140 18953 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:10.648283 19226 raft_consensus.cc:515] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.649881 17204 raft_consensus.cc:1275] T 5373f77eaf6a488faf35417ffdaa32b3 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260201 09:00:10.651198 17276 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:10.652379 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec25fe85ebfe48158cd273ded375fd96" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:10.647491 18539 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.610378 19143 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.661640 17840 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 4.
I20260201 09:00:10.662613 19143 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:10.663094 19226 leader_election.cc:290] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:10.656343 19182 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:10.663901 19182 raft_consensus.cc:493] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:10.664250 19182 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:10.665679 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.666517 17276 raft_consensus.cc:2393] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 5: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:10.679993 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.686936 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:10.680948 18539 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.698756 17276 raft_consensus.cc:2468] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:10.699978 17103 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:10.700881 19099 raft_consensus.cc:2804] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:10.701514 19099 raft_consensus.cc:697] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:10.702317 19099 consensus_queue.cc:237] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.705158 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:10.706501 17840 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260201 09:00:10.708196 18811 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260201 09:00:10.705082 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:10.709467 17134 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.712787 17209 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:10.713456 17209 raft_consensus.cc:2393] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:10.714171 17250 leader_election.cc:304] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:10.715759 17250 leader_election.cc:304] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:10.716110 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.717324 17102 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:10.718904 17102 leader_election.cc:304] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:10.719836 17174 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.722301 17102 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:10.722780 17209 raft_consensus.cc:3060] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.724977 19192 raft_consensus.cc:2749] T 08d6f47dbb384bb29b5d6f97211bcdfc P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:10.724371 19225 raft_consensus.cc:2749] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 09:00:10.724522 19196 consensus_queue.cc:1048] T 5373f77eaf6a488faf35417ffdaa32b3 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260201 09:00:10.725034 19226 raft_consensus.cc:2749] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260201 09:00:10.721218 19194 raft_consensus.cc:2749] T a4fc35bc514f47bc8de1d20b274d3416 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260201 09:00:10.724275 18501 raft_consensus.cc:2749] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:10.700805 18539 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:10.724448 19240 raft_consensus.cc:2749] T 2c3c8e7e03764c049810ad470ab313c7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260201 09:00:10.724136 17102 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.731616 19240 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:10.724750 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "71cc0a70e15b4a16b50124dc47a046cd" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:10.733987 17210 raft_consensus.cc:2393] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 5: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:10.740824 16955 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51048 (request call id 153) took 6257 ms. Trace:
I20260201 09:00:10.745173 17250 leader_election.cc:304] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:10.746711 19192 consensus_queue.cc:1048] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:10.749207 17134 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 7.
I20260201 09:00:10.750280 17790 leader_election.cc:304] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:10.752167 17209 raft_consensus.cc:1275] T 95c8a318ae314c74b860cee66450033c P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260201 09:00:10.756462 17250 leader_election.cc:304] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:10.758705 17174 leader_election.cc:304] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:10.761114 17250 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:10.741451 16955 rpcz_store.cc:276] 0201 09:00:04.483330 (+ 0us) service_pool.cc:168] Inserting onto call queue
0201 09:00:04.483481 (+ 151us) service_pool.cc:225] Handling call
0201 09:00:10.740743 (+6257262us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0201 09:00:10.237449 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0201 09:00:10.237975 (+ 526us) write_op.cc:432] Acquiring schema lock in shared mode
0201 09:00:10.238007 (+ 32us) write_op.cc:435] Acquired schema lock
0201 09:00:10.238022 (+ 15us) tablet.cc:660] Decoding operations
0201 09:00:10.239287 (+ 1265us) write_op.cc:620] Acquiring the partition lock for write op
0201 09:00:10.239338 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0201 09:00:10.239364 (+ 26us) tablet.cc:683] Acquiring locks for 17 operations
0201 09:00:10.240489 (+ 1125us) tablet.cc:699] Row locks acquired
0201 09:00:10.240505 (+ 16us) write_op.cc:260] PREPARE: finished
0201 09:00:10.240636 (+ 131us) write_op.cc:270] Start()
0201 09:00:10.240741 (+ 105us) write_op.cc:276] Timestamp: P: 1769936410240595 usec, L: 0
0201 09:00:10.240761 (+ 20us) op_driver.cc:348] REPLICATION: starting
0201 09:00:10.277038 (+ 36277us) log.cc:844] Serialized 6749 byte log entry
0201 09:00:10.557523 (+280485us) op_driver.cc:464] REPLICATION: finished
0201 09:00:10.609231 (+ 51708us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b440002304c. stack: 00007f74ad15a373 00007f74ad15a270 00007f74acaac574 00007f74b67686b4 00007f74b6768649 00007f74acfcc8b1 00007f74ad09b005 00007f74ad09ba22 00007f74afde557b 00007f74afde0e4f 00007f74ad16ef0c 00007f74b5f57709 00007f74ad18b57b 00007f74ad18981f 00007f74ad18bae2 00007f74b3c72e40
0201 09:00:10.694045 (+ 84814us) write_op.cc:301] APPLY: starting
0201 09:00:10.694123 (+ 78us) tablet.cc:1365] starting BulkCheckPresence
0201 09:00:10.694409 (+ 286us) tablet.cc:1368] finished BulkCheckPresence
0201 09:00:10.694430 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0201 09:00:10.696269 (+ 1839us) tablet.cc:1381] finished ApplyRowOperation cycle
0201 09:00:10.696500 (+ 231us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0201 09:00:10.696542 (+ 42us) write_op.cc:312] APPLY: finished
0201 09:00:10.696884 (+ 342us) log.cc:844] Serialized 118 byte log entry
0201 09:00:10.697042 (+ 158us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:10.697196 (+ 154us) write_op.cc:454] Released schema lock
0201 09:00:10.697245 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0201 09:00:10.697598 (+ 353us) write_op.cc:489] Releasing partition, row and schema locks
0201 09:00:10.697628 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8110,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":136269,"apply.run_cpu_time_us":3432,"apply.run_wall_time_us":3525,"num_ops":17,"prepare.queue_time_us":245199,"prepare.run_cpu_time_us":15090,"prepare.run_wall_time_us":128639,"raft.queue_time_us":80798,"raft.run_cpu_time_us":43408,"raft.run_wall_time_us":124650,"replication_time_us":316594,"spinlock_wait_cycles":31461248,"thread_start_us":398595,"threads_started":4,"wal-append.queue_time_us":143067}]]}
I20260201 09:00:10.767221 19121 raft_consensus.cc:2749] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260201 09:00:10.755561 19192 raft_consensus.cc:2749] T ec25fe85ebfe48158cd273ded375fd96 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:10.759434 19247 raft_consensus.cc:2804] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:10.767861 19121 consensus_queue.cc:1048] T ce4e1322b3134c60b0641a8941a7f76e P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260201 09:00:10.762080 18501 raft_consensus.cc:2749] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260201 09:00:10.768213 19211 raft_consensus.cc:2804] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Leader election won for term 8
I20260201 09:00:10.780346 19211 raft_consensus.cc:697] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [term 8 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:10.782799 19211 consensus_queue.cc:237] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.780272 18953 raft_consensus.cc:515] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.785920 17128 raft_consensus.cc:2368] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 09:00:10.721491 19182 raft_consensus.cc:515] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.792850 19247 raft_consensus.cc:697] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [term 7 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:10.802445 19247 consensus_queue.cc:237] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.808228 19073 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:10.808761 19073 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.809329 18953 leader_election.cc:290] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.810714 19073 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:10.817189 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.817888 17279 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:10.821280 17283 raft_consensus.cc:3060] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:10.822270 19182 leader_election.cc:290] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:10.859154 14089 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260201 09:00:10.867046 16960 catalog_manager.cc:5654] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 4, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68). New cstate: current_term: 4 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:10.875738 16960 catalog_manager.cc:5654] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 5 to 6, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 6 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:10.883988 16960 catalog_manager.cc:5654] T c35836a4583949f3b2ac7cbef2205db2 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 5, leader changed from 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66) to f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67). New cstate: current_term: 5 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 09:00:10.890731 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:10.892040 17134 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
W20260201 09:00:10.894500 17250 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 126749us
I20260201 09:00:10.896076 17250 leader_election.cc:304] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:10.898838 17250 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:10.898005 16960 catalog_manager.cc:5654] T 457eeb0a14cc4d28823521cfef13996e P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 6, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 6 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:10.903759 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:10.905081 17134 raft_consensus.cc:2368] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 6. Current term is 7.
I20260201 09:00:10.907166 17248 leader_election.cc:400] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 6. Current term is 7.
I20260201 09:00:10.907596 17248 leader_election.cc:403] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260201 09:00:10.919003 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:10.920156 17279 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:10.923036 17794 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:10.925936 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5713f7a57fd74d28b4576c047864054f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:10.926779 18811 raft_consensus.cc:2764] T 01d3235b5e3846929a4eeb9edb554d85 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260201 09:00:10.927807 18811 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:10.927968 18501 raft_consensus.cc:493] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:10.928370 18811 raft_consensus.cc:697] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:10.930330 19099 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:10.931077 18835 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:10.931649 18835 raft_consensus.cc:493] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:10.932049 18835 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:10.934238 18953 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:10.934818 19132 consensus_queue.cc:1048] T 95c8a318ae314c74b860cee66450033c P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260201 09:00:10.935060 18953 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.911216 16960 catalog_manager.cc:5654] T c7a634ccefb24b158e97cff94318758f P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 4 to 7, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 7 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 09:00:10.936511 19165 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:10.928009 18969 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:10.931119 19099 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:10.962124 17845 raft_consensus.cc:1275] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260201 09:00:10.964330 17276 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.964465 19247 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:10.965365 19247 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.968155 19247 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:10.969247 19099 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.970608 17276 raft_consensus.cc:2393] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 4: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:10.978261 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "19c509ac348a4d5b8b4a9760fa30c652" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:10.979419 17845 raft_consensus.cc:3060] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Advancing to term 6
I20260201 09:00:10.981907 17790 leader_election.cc:400] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 09:00:10.982353 17790 leader_election.cc:403] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260201 09:00:10.979066 16960 catalog_manager.cc:5654] T d454a89732b54703b564e1c647bbb335 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:10.981144 18501 raft_consensus.cc:515] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:10.986456 17206 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:10.987563 17206 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 8: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:10.988310 18811 consensus_queue.cc:237] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:10.990504 18501 leader_election.cc:290] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.992354 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:10.993338 17277 raft_consensus.cc:2393] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 in current term 3: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:10.993525 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:10.994346 17843 raft_consensus.cc:2393] T 8756377c82b244dba54033faa382e693 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 8: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:10.995309 18953 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:10.996531 16960 catalog_manager.cc:5654] T 73e3e5cdfd85463abd7eeb4fe5b87c77 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } }
I20260201 09:00:10.987493 19132 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260201 09:00:11.005329 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8756377c82b244dba54033faa382e693" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.005077 19165 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.020148 17175 leader_election.cc:304] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:11.021916 19259 raft_consensus.cc:3060] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:10.998754 16960 catalog_manager.cc:5654] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 7, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 7 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:11.027127 18814 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.027796 18814 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:11.034384 17134 raft_consensus.cc:1275] T e2d7b23e195941c5a5d351fc04a2a64d P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 09:00:11.045478 17840 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:11.050953 18814 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.051070 19192 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.052089 19192 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:11.039283 19132 consensus_queue.cc:1048] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260201 09:00:11.082226 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.086133 17134 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 2.
I20260201 09:00:11.041131 18969 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:11.083576 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.090229 17279 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:11.099603 17128 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 7.
I20260201 09:00:11.102851 19259 raft_consensus.cc:2749] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260201 09:00:11.104348 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.105054 17277 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 8.
I20260201 09:00:11.104377 17204 raft_consensus.cc:1275] T 8756377c82b244dba54033faa382e693 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260201 09:00:11.082087 19165 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.110801 17846 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:11.111883 17846 raft_consensus.cc:2393] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 7: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:11.113138 17847 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:11.113607 18953 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.114181 18953 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.113881 17847 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 3.
I20260201 09:00:11.116016 16960 catalog_manager.cc:5654] T 9dd88f5c612b4e5985855eee079c4716 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:11.122606 18969 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:11.123198 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.120478 16960 catalog_manager.cc:5654] T fe590c5ab6064559bcc7599baa5667c5 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f97c64e8acf34ae28a520dd40fc5281c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } health_report { overall_health: UNKNOWN } } }
I20260201 09:00:11.128727 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.129968 17277 raft_consensus.cc:2393] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 7: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:11.128916 17790 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:11.116679 18953 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:11.130061 16960 catalog_manager.cc:5654] T 85f87e31da9e48ee853c4246adc1a1a2 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 2 to 4, leader changed from f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67) to 35484ac93d564e958f85965bd740a18f (127.13.194.65). New cstate: current_term: 4 leader_uuid: "35484ac93d564e958f85965bd740a18f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:11.129213 17847 raft_consensus.cc:1275] T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260201 09:00:11.130950 18743 raft_consensus.cc:2804] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:11.131379 18743 raft_consensus.cc:493] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.131784 18743 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:11.132660 19132 consensus_queue.cc:1048] T e2d7b23e195941c5a5d351fc04a2a64d P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260201 09:00:11.135183 17103 leader_election.cc:304] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.136229 19099 raft_consensus.cc:2804] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader election won for term 6
I20260201 09:00:11.136790 19099 raft_consensus.cc:697] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:11.138257 17285 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 5.
I20260201 09:00:11.142737 19099 consensus_queue.cc:237] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:11.143169 17843 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:11.143989 17843 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 7.
I20260201 09:00:11.148774 17103 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.149888 19240 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:11.146579 18743 raft_consensus.cc:515] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:11.154207 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:11.154853 17132 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 2 FOLLOWER]: Advancing to term 4
I20260201 09:00:11.159852 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.150283 19240 raft_consensus.cc:493] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.161128 17285 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 3.
I20260201 09:00:11.161204 19240 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:11.167088 17283 raft_consensus.cc:2468] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 7.
I20260201 09:00:11.167889 19121 raft_consensus.cc:2749] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f97c64e8acf34ae28a520dd40fc5281c for earlier term 6. Current term is 7.
I20260201 09:00:11.177394 17132 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:11.178750 17790 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:11.179800 19247 raft_consensus.cc:2804] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 4 FOLLOWER]: Leader election won for term 4
I20260201 09:00:11.180311 19247 raft_consensus.cc:697] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [term 4 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:11.181270 19247 consensus_queue.cc:237] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:11.187557 19192 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:11.157727 18743 leader_election.cc:290] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 4 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.190066 16960 catalog_manager.cc:5654] T 22ea6a68454747bf8c2fb8b0af084d3a P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } }
I20260201 09:00:11.194239 17101 leader_election.cc:304] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:11.196256 19196 raft_consensus.cc:2764] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260201 09:00:11.197119 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
W20260201 09:00:11.200039 17174 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.66:41977, user_credentials={real_user=slave}} blocked reactor thread for 90967.7us
I20260201 09:00:11.201793 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5f3df5d3bc344959e184b53bca122d4" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:11.202445 17279 raft_consensus.cc:3060] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:11.205080 18569 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:11.205585 18569 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3dee892ea94d4f2a92316ad6f79edca2)
I20260201 09:00:11.205966 18569 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
W20260201 09:00:11.207021 17175 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.65:45571, user_credentials={real_user=slave}} blocked reactor thread for 67310.9us
I20260201 09:00:11.209657 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:11.210328 17842 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 7.
I20260201 09:00:11.208235 17175 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:11.218034 18969 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:11.218456 18969 raft_consensus.cc:493] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:11.218786 19226 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.219422 19226 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.220994 17249 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.223356 18811 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260201 09:00:11.223737 18811 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.224054 18811 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Advancing to term 9
I20260201 09:00:11.218873 18969 raft_consensus.cc:3060] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:11.220990 17794 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:11.230268 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.231017 17285 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:11.232121 17103 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.233034 18814 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:11.233501 18814 raft_consensus.cc:493] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:11.234040 18814 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:11.224104 19226 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:11.233911 19196 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260201 09:00:11.236059 19196 raft_consensus.cc:493] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.236413 19196 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:11.243795 17279 raft_consensus.cc:2468] T d5f3df5d3bc344959e184b53bca122d4 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 4.
I20260201 09:00:11.245455 19192 consensus_queue.cc:1048] T 8756377c82b244dba54033faa382e693 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260201 09:00:11.197160 19240 raft_consensus.cc:515] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.255167 17128 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260201 09:00:11.255595 19240 leader_election.cc:290] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:11.257285 17845 raft_consensus.cc:2468] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:11.257514 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:11.259449 19073 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260201 09:00:11.261824 18835 raft_consensus.cc:515] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:11.290148 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.290846 17840 raft_consensus.cc:2368] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:11.290810 17210 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:11.292169 17842 raft_consensus.cc:3060] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:11.284446 18969 raft_consensus.cc:515] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:11.293435 18835 leader_election.cc:290] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.289588 19119 raft_consensus.cc:2749] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977) with higher term. Message: Invalid argument: T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 5. Current term is 6.
I20260201 09:00:11.294510 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:11.280936 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.295241 17283 raft_consensus.cc:2393] T 7f2feb4eecaf434f8a756b3934813632 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 7: Already voted for candidate f97c64e8acf34ae28a520dd40fc5281c in this term.
I20260201 09:00:11.295480 17207 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 6.
I20260201 09:00:11.287727 17285 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Advancing to term 7
I20260201 09:00:11.278844 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.297417 17202 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 8.
I20260201 09:00:11.301484 17283 raft_consensus.cc:1275] T 71cc0a70e15b4a16b50124dc47a046cd P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260201 09:00:11.301680 19297 log.cc:927] Time spent T e2d7b23e195941c5a5d351fc04a2a64d P 35484ac93d564e958f85965bd740a18f: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260201 09:00:11.303304 19240 consensus_queue.cc:1048] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:11.278174 18814 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:11.303846 16960 catalog_manager.cc:5654] T 9bad6ae52daf4b8bba5e450dbee00fe0 P f97c64e8acf34ae28a520dd40fc5281c reported cstate change: term changed from 2 to 3, leader changed from f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68) to 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66). New cstate: current_term: 3 leader_uuid: "3dee892ea94d4f2a92316ad6f79edca2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } }
I20260201 09:00:11.306030 18814 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:11.306591 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:11.308216 17202 raft_consensus.cc:2393] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 8: Already voted for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in this term.
I20260201 09:00:11.283413 19196 raft_consensus.cc:515] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.311903 17285 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:11.313891 17103 leader_election.cc:304] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.316668 17842 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260201 09:00:11.292645 18811 raft_consensus.cc:515] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:11.320956 17285 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:11.321902 17101 leader_election.cc:400] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:11.322578 17101 leader_election.cc:403] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260201 09:00:11.324818 17210 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6c4831e95cb49de81c217e813d2a06d" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:11.326020 17210 raft_consensus.cc:3060] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:11.325183 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:11.327749 17134 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Advancing to term 5
I20260201 09:00:11.331024 17279 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a5c32dbf875b45d7944fd036d09edc64" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:11.332656 17279 raft_consensus.cc:3060] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Advancing to term 5
I20260201 09:00:11.318810 19240 raft_consensus.cc:2804] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:11.333642 19196 leader_election.cc:290] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:11.350008 17276 raft_consensus.cc:1275] T 5713f7a57fd74d28b4576c047864054f P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260201 09:00:11.337874 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:11.342887 17207 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d3dae430c6f4b21a70c4dd16b3dd446" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:11.351450 17207 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:11.358412 18811 leader_election.cc:290] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 9 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:11.360003 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:11.360616 17211 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Advancing to term 9
I20260201 09:00:11.363530 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4eaf0bffdc44689593bcfe6cc4cbf1" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:11.364144 17845 raft_consensus.cc:3060] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Advancing to term 9
I20260201 09:00:11.364334 18835 consensus_queue.cc:1048] T 5713f7a57fd74d28b4576c047864054f P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:11.368916 17134 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:11.369486 19226 raft_consensus.cc:2749] T a5c32dbf875b45d7944fd036d09edc64 P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571) with higher term. Message: Invalid argument: T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3dee892ea94d4f2a92316ad6f79edca2 for earlier term 4. Current term is 5.
I20260201 09:00:11.373117 17279 raft_consensus.cc:2468] T a5c32dbf875b45d7944fd036d09edc64 P f97c64e8acf34ae28a520dd40fc5281c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:11.373482 17845 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 9.
I20260201 09:00:11.344590 17285 raft_consensus.cc:2368] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 8. Current term is 9.
I20260201 09:00:11.348634 19211 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260201 09:00:11.336714 17202 raft_consensus.cc:1275] T 71cc0a70e15b4a16b50124dc47a046cd P f5398ba4a58b40ca9b78a210cdb7ae4d [term 5 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260201 09:00:11.351028 17277 raft_consensus.cc:3060] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Advancing to term 7
I20260201 09:00:11.381006 17794 leader_election.cc:304] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.382182 17207 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:11.383137 17210 raft_consensus.cc:2468] T f6c4831e95cb49de81c217e813d2a06d P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:11.383882 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f2feb4eecaf434f8a756b3934813632" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:11.276777 18569 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.389465 18569 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.390154 17845 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:11.391563 17845 raft_consensus.cc:2393] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 7: Already voted for candidate 35484ac93d564e958f85965bd740a18f in this term.
I20260201 09:00:11.391809 17249 leader_election.cc:304] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.392671 17842 raft_consensus.cc:2468] T 7f2feb4eecaf434f8a756b3934813632 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 7.
I20260201 09:00:11.398049 17175 leader_election.cc:304] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:11.370108 18969 leader_election.cc:290] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 election: Requested vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571)
I20260201 09:00:11.394343 18835 raft_consensus.cc:2804] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader election won for term 5
I20260201 09:00:11.409240 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:11.400270 19192 raft_consensus.cc:2804] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 9 FOLLOWER]: Leader election won for term 9
I20260201 09:00:11.396276 19240 raft_consensus.cc:697] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:11.422858 17277 raft_consensus.cc:2468] T 5d3dae430c6f4b21a70c4dd16b3dd446 P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:11.404179 18569 raft_consensus.cc:2804] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:11.401160 18953 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.419531 17794 leader_election.cc:400] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 election: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 8. Current term is 9.
I20260201 09:00:11.430681 17794 leader_election.cc:403] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260201 09:00:11.383963 19099 consensus_queue.cc:1048] T 71cc0a70e15b4a16b50124dc47a046cd P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260201 09:00:11.428951 17207 raft_consensus.cc:1275] T 08be66650c334ab1b9d801bb366c9969 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260201 09:00:11.430037 17211 raft_consensus.cc:2468] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 9.
I20260201 09:00:11.432974 18539 raft_consensus.cc:2749] T da4eaf0bffdc44689593bcfe6cc4cbf1 P 35484ac93d564e958f85965bd740a18f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925) with higher term. Message: Invalid argument: T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f for earlier term 8. Current term is 9.
I20260201 09:00:11.429561 19192 raft_consensus.cc:697] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [term 9 LEADER]: Becoming Leader. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:11.432971 18953 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.434770 19192 consensus_queue.cc:237] T da4eaf0bffdc44689593bcfe6cc4cbf1 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:11.436000 18953 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:11.437127 19121 consensus_queue.cc:1048] T 08be66650c334ab1b9d801bb366c9969 P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:11.439056 17102 leader_election.cc:304] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:11.440053 19305 raft_consensus.cc:2804] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:11.440608 19305 raft_consensus.cc:697] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 LEADER]: Becoming Leader. State: Replica: 3dee892ea94d4f2a92316ad6f79edca2, State: Running, Role: LEADER
I20260201 09:00:11.421330 18835 raft_consensus.cc:697] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [term 5 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:11.444044 19305 consensus_queue.cc:237] T 5d3dae430c6f4b21a70c4dd16b3dd446 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.445029 18835 consensus_queue.cc:237] T a5c32dbf875b45d7944fd036d09edc64 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:11.447216 17283 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.444259 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.457595 17208 raft_consensus.cc:2468] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3dee892ea94d4f2a92316ad6f79edca2 in term 7.
I20260201 09:00:11.462461 17102 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:11.472258 18569 raft_consensus.cc:697] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:11.477167 18569 consensus_queue.cc:237] T 7f2feb4eecaf434f8a756b3934813632 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } }
I20260201 09:00:11.490113 17134 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 7.
I20260201 09:00:11.475607 19099 raft_consensus.cc:2804] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:11.506860 19099 raft_consensus.cc:493] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260201 09:00:11.550228 17102 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.194.67:33911, user_credentials={real_user=slave}} blocked reactor thread for 87873.5us
I20260201 09:00:11.538491 19099 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:11.553333 17174 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 35484ac93d564e958f85965bd740a18f
I20260201 09:00:11.511706 19240 consensus_queue.cc:237] T f6c4831e95cb49de81c217e813d2a06d P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.561195 18569 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Leader election won for term 7
I20260201 09:00:11.568033 19288 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.607333 19257 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:11.574661 18569 raft_consensus.cc:697] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:11.616066 18569 consensus_queue.cc:237] T fe438a8cca4545538587c8be3489cf00 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.601351 19288 raft_consensus.cc:515] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.607975 19257 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.621284 19257 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.623677 17211 raft_consensus.cc:1275] T de4970dd965f43208c799dedd555e5dc P f5398ba4a58b40ca9b78a210cdb7ae4d [term 7 FOLLOWER]: Refusing update from remote peer f97c64e8acf34ae28a520dd40fc5281c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260201 09:00:11.625386 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f" is_pre_election: true
I20260201 09:00:11.626052 17842 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 9.
I20260201 09:00:11.627844 19121 consensus_queue.cc:1048] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260201 09:00:11.629030 17175 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters:
I20260201 09:00:11.633028 19257 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260201 09:00:11.633777 19257 raft_consensus.cc:493] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 35484ac93d564e958f85965bd740a18f)
I20260201 09:00:11.634426 19257 raft_consensus.cc:3060] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 8 FOLLOWER]: Advancing to term 9
I20260201 09:00:11.635254 19288 leader_election.cc:290] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:11.636823 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.641244 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "419daee934394566a5c13ed9d478cb25" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.644114 17132 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P 3dee892ea94d4f2a92316ad6f79edca2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 09:00:11.645426 17248 leader_election.cc:304] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.653360 17204 raft_consensus.cc:2468] T 419daee934394566a5c13ed9d478cb25 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 3.
I20260201 09:00:11.654474 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.655249 17130 raft_consensus.cc:2393] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 9: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:11.656489 19211 raft_consensus.cc:2804] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260201 09:00:11.668206 18743 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.672959 18743 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.674875 19099 raft_consensus.cc:515] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.676326 19119 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.676882 19119 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.676544 17134 raft_consensus.cc:1240] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Rejecting Update request from peer f97c64e8acf34ae28a520dd40fc5281c for earlier term 7. Current term is 8. Ops: []
I20260201 09:00:11.677767 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c"
I20260201 09:00:11.678830 19119 leader_election.cc:290] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:11.679244 19257 raft_consensus.cc:515] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.679597 17208 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de4970dd965f43208c799dedd555e5dc" candidate_uuid: "3dee892ea94d4f2a92316ad6f79edca2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:11.679340 19288 consensus_queue.cc:1059] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260201 09:00:11.674898 18743 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:11.680347 19288 raft_consensus.cc:3055] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Stepping down as leader of term 7
I20260201 09:00:11.680559 19099 leader_election.cc:290] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 election: Requested vote from peers f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911), f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925)
I20260201 09:00:11.680795 19288 raft_consensus.cc:740] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f97c64e8acf34ae28a520dd40fc5281c, State: Running, Role: LEADER
I20260201 09:00:11.681759 19288 consensus_queue.cc:260] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.682957 19288 raft_consensus.cc:3060] T de4970dd965f43208c799dedd555e5dc P f97c64e8acf34ae28a520dd40fc5281c [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:11.670958 19211 raft_consensus.cc:493] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.684276 19211 raft_consensus.cc:3060] T 419daee934394566a5c13ed9d478cb25 P f97c64e8acf34ae28a520dd40fc5281c [term 3 FOLLOWER]: Advancing to term 4
I20260201 09:00:11.685242 17202 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.687554 17130 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.688194 17130 raft_consensus.cc:2468] T b713edafee9f47fcaeed41159ac7e30d P 3dee892ea94d4f2a92316ad6f79edca2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 5.
I20260201 09:00:11.689612 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.690239 17134 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 7.
I20260201 09:00:11.691977 17204 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.692159 17842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "35484ac93d564e958f85965bd740a18f"
I20260201 09:00:11.692762 17790 leader_election.cc:304] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters:
I20260201 09:00:11.694054 17102 leader_election.cc:304] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d, f97c64e8acf34ae28a520dd40fc5281c
I20260201 09:00:11.697894 19305 raft_consensus.cc:2749] T de4970dd965f43208c799dedd555e5dc P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260201 09:00:11.705096 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea425e459b1e4b09b34817d64cea28e7" candidate_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:11.706457 17134 raft_consensus.cc:2393] T ea425e459b1e4b09b34817d64cea28e7 P 3dee892ea94d4f2a92316ad6f79edca2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5398ba4a58b40ca9b78a210cdb7ae4d in current term 9: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:11.716128 17845 raft_consensus.cc:1275] T 19c509ac348a4d5b8b4a9760fa30c652 P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260201 09:00:11.698136 17790 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:11.718714 19247 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:11.719123 19247 raft_consensus.cc:493] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.720835 17842 raft_consensus.cc:2468] T ea425e459b1e4b09b34817d64cea28e7 P 35484ac93d564e958f85965bd740a18f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5398ba4a58b40ca9b78a210cdb7ae4d in term 9.
I20260201 09:00:11.719534 19247 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:11.722157 17175 leader_election.cc:304] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f5398ba4a58b40ca9b78a210cdb7ae4d; no voters: 3dee892ea94d4f2a92316ad6f79edca2
I20260201 09:00:11.722959 18969 raft_consensus.cc:2804] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 9 FOLLOWER]: Leader election won for term 9
I20260201 09:00:11.723454 18969 raft_consensus.cc:697] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [term 9 LEADER]: Becoming Leader. State: Replica: f5398ba4a58b40ca9b78a210cdb7ae4d, State: Running, Role: LEADER
I20260201 09:00:11.724298 18969 consensus_queue.cc:237] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.724752 17130 raft_consensus.cc:1275] T d5f3df5d3bc344959e184b53bca122d4 P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Refusing update from remote peer 35484ac93d564e958f85965bd740a18f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260201 09:00:11.726858 19119 consensus_queue.cc:1048] T d5f3df5d3bc344959e184b53bca122d4 P 35484ac93d564e958f85965bd740a18f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:11.718976 18743 raft_consensus.cc:2804] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260201 09:00:11.729163 18743 raft_consensus.cc:493] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.729564 18743 raft_consensus.cc:3060] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 5 FOLLOWER]: Advancing to term 6
I20260201 09:00:11.747207 19226 consensus_queue.cc:1048] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260201 09:00:11.699415 19257 leader_election.cc:290] T ea425e459b1e4b09b34817d64cea28e7 P f5398ba4a58b40ca9b78a210cdb7ae4d [CANDIDATE]: Term 9 election: Requested vote from peers 35484ac93d564e958f85965bd740a18f (127.13.194.65:45571), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.758574 19290 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 09:00:11.759328 19290 raft_consensus.cc:515] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } } peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } }
I20260201 09:00:11.755764 19143 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:11.762387 19143 raft_consensus.cc:515] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 } } peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } }
I20260201 09:00:11.765589 17277 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f97c64e8acf34ae28a520dd40fc5281c" is_pre_election: true
I20260201 09:00:11.766305 17277 raft_consensus.cc:2468] T f4d85af3240d4e3b858634e83c48c93e P f97c64e8acf34ae28a520dd40fc5281c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 8.
I20260201 09:00:11.766305 17283 raft_consensus.cc:1275] T 19c509ac348a4d5b8b4a9760fa30c652 P f97c64e8acf34ae28a520dd40fc5281c [term 6 FOLLOWER]: Refusing update from remote peer 3dee892ea94d4f2a92316ad6f79edca2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260201 09:00:11.764559 19143 leader_election.cc:290] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f97c64e8acf34ae28a520dd40fc5281c (127.13.194.68:45925), 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977)
I20260201 09:00:11.768254 17794 leader_election.cc:304] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.770478 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4d85af3240d4e3b858634e83c48c93e" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.771919 17134 raft_consensus.cc:2393] T f4d85af3240d4e3b858634e83c48c93e P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35484ac93d564e958f85965bd740a18f in current term 8: Already voted for candidate 3dee892ea94d4f2a92316ad6f79edca2 in this term.
I20260201 09:00:11.770879 19240 consensus_queue.cc:1048] T 19c509ac348a4d5b8b4a9760fa30c652 P 3dee892ea94d4f2a92316ad6f79edca2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f97c64e8acf34ae28a520dd40fc5281c" member_type: VOTER last_known_addr { host: "127.13.194.68" port: 45925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260201 09:00:11.772632 18835 raft_consensus.cc:2804] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260201 09:00:11.777180 18835 raft_consensus.cc:493] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Starting leader election (detected failure of leader f97c64e8acf34ae28a520dd40fc5281c)
I20260201 09:00:11.777572 18835 raft_consensus.cc:3060] T f4d85af3240d4e3b858634e83c48c93e P 35484ac93d564e958f85965bd740a18f [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:11.775759 19247 raft_consensus.cc:515] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.781195 17132 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"
I20260201 09:00:11.782008 19290 leader_election.cc:290] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:11.782095 17132 raft_consensus.cc:3060] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 7 FOLLOWER]: Advancing to term 8
I20260201 09:00:11.784613 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe438a8cca4545538587c8be3489cf00" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d"
I20260201 09:00:11.787169 17128 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2" is_pre_election: true
I20260201 09:00:11.787791 17128 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P 3dee892ea94d4f2a92316ad6f79edca2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:11.789924 17248 leader_election.cc:304] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dee892ea94d4f2a92316ad6f79edca2, f97c64e8acf34ae28a520dd40fc5281c; no voters:
I20260201 09:00:11.790704 17132 raft_consensus.cc:2468] T fe438a8cca4545538587c8be3489cf00 P 3dee892ea94d4f2a92316ad6f79edca2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35484ac93d564e958f85965bd740a18f in term 8.
I20260201 09:00:11.791728 17790 leader_election.cc:304] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35484ac93d564e958f85965bd740a18f, 3dee892ea94d4f2a92316ad6f79edca2; no voters: f5398ba4a58b40ca9b78a210cdb7ae4d
I20260201 09:00:11.793200 19073 raft_consensus.cc:2804] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 8 FOLLOWER]: Leader election won for term 8
I20260201 09:00:11.793654 19073 raft_consensus.cc:697] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [term 8 LEADER]: Becoming Leader. State: Replica: 35484ac93d564e958f85965bd740a18f, State: Running, Role: LEADER
I20260201 09:00:11.794760 19247 leader_election.cc:290] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [CANDIDATE]: Term 8 election: Requested vote from peers 3dee892ea94d4f2a92316ad6f79edca2 (127.13.194.66:41977), f5398ba4a58b40ca9b78a210cdb7ae4d (127.13.194.67:33911)
I20260201 09:00:11.794477 19073 consensus_queue.cc:237] T fe438a8cca4545538587c8be3489cf00 P 35484ac93d564e958f85965bd740a18f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.798388 17211 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76831f67d1c74e10a89a36c2fed5f81f" candidate_uuid: "f97c64e8acf34ae28a520dd40fc5281c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" is_pre_election: true
I20260201 09:00:11.799042 17211 raft_consensus.cc:2468] T 76831f67d1c74e10a89a36c2fed5f81f P f5398ba4a58b40ca9b78a210cdb7ae4d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f97c64e8acf34ae28a520dd40fc5281c in term 4.
I20260201 09:00:11.799749 19290 raft_consensus.cc:2804] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260201 09:00:11.800164 19290 raft_consensus.cc:493] T 76831f67d1c74e10a89a36c2fed5f81f P f97c64e8acf34ae28a520dd40fc5281c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 09:00:11.807157 18743 raft_consensus.cc:515] T b713edafee9f47fcaeed41159ac7e30d P 35484ac93d564e958f85965bd740a18f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35484ac93d564e958f85965bd740a18f" member_type: VOTER last_known_addr { host: "127.13.194.65" port: 45571 } } peers { permanent_uuid: "3dee892ea94d4f2a92316ad6f79edca2" member_type: VOTER last_known_addr { host: "127.13.194.66" port: 41977 } } peers { permanent_uuid: "f5398ba4a58b40ca9b78a210cdb7ae4d" member_type: VOTER last_known_addr { host: "127.13.194.67" port: 33911 } }
I20260201 09:00:11.811892 17134 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b713edafee9f47fcaeed41159ac7e30d" candidate_uuid: "35484ac93d564e958f85965bd740a18f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3dee892ea94d4f2a92316ad6f79edca2"